Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8958 originally caused by: Started by upstream project "master-osmo-mgw" build number 9190 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8713 originally caused by: Started by upstream project "master-osmo-hlr" build number 8848 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30083 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37249 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29300 originally caused by: Started by upstream project "master-osmo-msc" build number 34260 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9125 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "master-osmo-mgw" build number 9190 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17677 originally caused by: Started by upstream project "master-osmo-bsc" build number 20138 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9125 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "master-osmo-mgw" build number 9190 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30084 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37250 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9125 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37251 originally caused by: Started by upstream project "master-osmo-iuh" build number 12870 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9125 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12988 originally caused by: Started by upstream project "master-openbsc" build number 13185 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9125 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29301 originally caused by: Started by upstream project "master-osmo-msc" build number 34261 originally caused by: Started by upstream project "master-osmo-iuh" build number 12870 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9125 originally caused by: Started by upstream project "master-libosmo-netif" build number 6966 originally caused by: Started by upstream project "master-libosmo-abis" build number 4960 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9255 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9126 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30085 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37252 originally caused by: Started by upstream project "master-osmo-iuh" build number 12871 originally caused by: Started by upstream project "master-libasn1c" build number 1809 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37253 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9126 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17678 originally caused by: Started by upstream project "master-osmo-bsc" build number 20139 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9126 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29302 originally caused by: Started by upstream project "master-osmo-msc" build number 34262 originally caused by: Started by upstream project "master-osmo-iuh" build number 12871 originally caused by: Started by upstream project "master-libasn1c" build number 1809 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34263 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9126 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30086 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37254 originally caused by: Started by upstream project "master-osmo-iuh" build number 12872 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9126 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12989 originally caused by: Started by upstream project "master-openbsc" build number 13186 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9126 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29303 originally caused by: Started by upstream project "master-osmo-msc" build number 34264 originally caused by: Started by upstream project "master-osmo-iuh" build number 12872 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9126 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17679 originally caused by: Started by upstream project "master-osmo-bsc" build number 20140 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7509 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6689 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8713 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8958 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2984 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29303 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5153 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30086 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12989 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9255 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8040 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5192 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5536 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3910 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins15874242377060373742.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 08:32:40 + trial_dir_prefix=trial- + rm -rf trial-2384 trial-2384-bin.tgz trial-2384-run.tgz + trial_dir=trial-2387 + mkdir -p trial-2387 + mv open5gs.build-8.tgz osmo-bsc.build-17679.tgz osmo-bts-oc2g.build-5536.tgz osmo-bts-sysmo.build-8040.tgz osmo-bts.build-7509.tgz osmo-ggsn.build-6689.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2984.tgz osmo-mgw.build-8958.tgz osmo-msc.build-29303.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3910.tgz osmo-pcu-sysmo.build-5192.tgz osmo-pcu.build-5153.tgz osmo-sgsn.build-30086.tgz osmo-stp.build-9255.tgz osmo-trx.build-4680.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2387 + cat open5gs.build-8.md5 osmo-bsc.build-17679.md5 osmo-bts-oc2g.build-5536.md5 osmo-bts-sysmo.build-8040.md5 osmo-bts.build-7509.md5 osmo-ggsn.build-6689.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2984.md5 osmo-mgw.build-8958.md5 osmo-msc.build-29303.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3910.md5 osmo-pcu-sysmo.build-5192.md5 osmo-pcu.build-5153.md5 osmo-sgsn.build-30086.md5 osmo-stp.build-9255.md5 osmo-trx.build-4680.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17679.md5 osmo-bts-oc2g.build-5536.md5 osmo-bts-sysmo.build-8040.md5 osmo-bts.build-7509.md5 osmo-ggsn.build-6689.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2984.md5 osmo-mgw.build-8958.md5 osmo-msc.build-29303.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3910.md5 osmo-pcu-sysmo.build-5192.md5 osmo-pcu.build-5153.md5 osmo-sgsn.build-30086.md5 osmo-stp.build-9255.md5 osmo-trx.build-4680.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2387 combinations: None trial: 'trial-2387' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2387 -------------------------------------------------------------------------------------------- 08:32:52.081249 tst trial-2387: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/log --------------------------------------------------------------------- trial-2387 nitb_sms:sysmo --------------------------------------------------------------------- 08:35:00.578431 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:00.581938 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 08:35:00.602590 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 08:35:00.609391 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 08:35:00.666210 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 08:35:00.687083 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 08:35:00.693765 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 08:35:01.261478 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:35:01.272491 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 08:35:01.290523 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 08:35:01.725385 tst mo_mt_sms.py: using LAC 32742 08:35:01.982400 tst mo_mt_sms.py: using RAC 102 08:35:02.131298 tst mo_mt_sms.py: using CellId 32742 08:35:02.259083 tst mo_mt_sms.py: using BVCI 32743 08:35:02.392536 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:35:02.573962 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:35:02.694462 tst mo_mt_sms.py:9: start nitb and bts... 08:35:02.913966 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:35:05.284048 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26354): Launched 08:35:05.613266 run osmo-nitb_10.42.42.2(pid=26355): Launched 08:35:05.792100 run osmo-nitb_10.42.42.2(pid=26355): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26355)] 08:35:05.926060 run osmo-nitb_10.42.42.2(pid=26355): stdout: | (launched: 2022-12-13_08:35:05.552306) 08:35:06.061595 run osmo-nitb_10.42.42.2(pid=26355): stderr: | (launched: 2022-12-13_08:35:05.601199) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:35:06.197263 run osmo-nitb_10.42.42.2(pid=26355): stdout: | (launched: 2022-12-13_08:35:05.552306) 08:35:06.326950 run osmo-nitb_10.42.42.2(pid=26355): stderr: | (launched: 2022-12-13_08:35:05.601199) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:35:06.482383 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26355): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26355) [trial-2387↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26355)] [trial-2387↪nitb_sms:sysmo↪mo_mt_sms.py:11] 08:35:06.491150 tst mo_mt_sms.py:11: Test FAILED (5.2 sec) 08:35:06.498088 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26354): Terminating (SIGTERM) 08:35:06.708628 --- ParallelTerminationStrategy: PID 26354 died... 08:35:06.729980 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26354): Terminated: ok {rc=0} 08:35:06.818979 bus /sierra_3: Setting Powered False 08:35:07.919779 bus /sierra_3: Setting Powered False 08:35:09.048554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:sysmo --------------------------------------------------------------------- 08:35:10.239575 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:10.243764 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 08:35:10.264411 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 08:35:10.291680 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 08:35:10.344048 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 08:35:10.365054 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 08:35:10.392218 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 08:35:10.942501 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:35:10.948592 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:35:10.960033 tst sms:sysmo: Using 1 x bts (candidates: 1) 08:35:10.995423 tst mo_mt_sms.py: using LAC 32743 08:35:11.121537 tst mo_mt_sms.py: using RAC 103 08:35:11.242358 tst mo_mt_sms.py: using CellId 32743 08:35:11.362616 tst mo_mt_sms.py: using BVCI 32744 08:35:11.474963 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:35:11.485758 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:35:11.496244 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:35:11.506676 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:35:11.517163 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:35:11.527740 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:35:11.644486 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:35:11.767433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:13.550677 run create_hlr_db(pid=26360): Launched 08:35:13.687646 bus /sierra_2: Setting Powered False 08:35:14.751452 run create_hlr_db(pid=26360): Terminated: ok {rc=0} 08:35:15.190718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26362): Launched 08:35:15.502391 run osmo-hlr_10.42.42.2(pid=26363): Launched 08:35:15.621573 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:18.276476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26365): Launched 08:35:18.606722 run osmo-stp_10.42.42.5(pid=26366): Launched 08:35:18.733243 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:24.235917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26368): Launched 08:35:24.563679 run osmo-msc_10.42.42.6(pid=26369): Launched 08:35:24.746235 run osmo-stp_10.42.42.5(pid=26366): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26366)] 08:35:24.884443 run osmo-stp_10.42.42.5(pid=26366): stdout: | (launched: 2022-12-13_08:35:18.545776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:25.021757 run osmo-stp_10.42.42.5(pid=26366): stderr: | 20221213083518742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083518742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083518742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083518743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083518743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083518744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083518744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:25.158527 run osmo-stp_10.42.42.5(pid=26366): stdout: | (launched: 2022-12-13_08:35:18.545776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:25.288846 run osmo-stp_10.42.42.5(pid=26366): stderr: | 20221213083518742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083518742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083518742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083518743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083518743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083518744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083518744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:25.446530 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26366): Process ended prematurely: osmo-stp_10.42.42.5(pid=26366) [trial-2387↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26366)] [trial-2387↪sms:sysmo↪mo_mt_sms.py:16] 08:35:25.455446 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 08:35:25.482908 run osmo-hlr_10.42.42.2(pid=26363): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26363)] 08:35:25.535083 run osmo-hlr_10.42.42.2(pid=26363): stdout: | (launched: 2022-12-13_08:35:15.444398) 08:35:25.587433 run osmo-hlr_10.42.42.2(pid=26363): stderr: | 20221213083515625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083515625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083515625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083515625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083515625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083515625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083515653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083515663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083515663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083515663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:25.660729 run osmo-msc_10.42.42.6(pid=26369): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26369)] 08:35:25.711383 run osmo-msc_10.42.42.6(pid=26369): stdout: | (launched: 2022-12-13_08:35:24.502536) 08:35:25.763568 run osmo-msc_10.42.42.6(pid=26369): stderr: | 20221213083524829 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083524830 DLGLOBAL DEBUG validating counter group 0x7ffb4e9d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083524830 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083524830 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083524830 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083524830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083524832 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083524832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083524832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083524832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:25.816234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26362): Terminating (SIGTERM) 08:35:25.858535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26365): Terminating (SIGTERM) 08:35:25.901523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26368): Terminating (SIGTERM) 08:35:25.944691 --- ParallelTerminationStrategy: PID 26362 died... 08:35:25.965139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26362): Terminated: ok {rc=0} 08:35:26.011643 --- ParallelTerminationStrategy: PID 26365 died... 08:35:26.031345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26365): Terminated: ok {rc=0} 08:35:26.077879 --- ParallelTerminationStrategy: PID 26368 died... 08:35:26.097612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26368): Terminated: ok {rc=0} 08:35:26.186178 bus /sierra_3: Setting Powered False 08:35:27.285568 bus /sierra_3: Setting Powered False 08:35:28.400508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:sysmo --------------------------------------------------------------------- 08:35:29.624524 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:29.629167 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:35:29.650649 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 08:35:29.657758 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:35:29.693007 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:35:29.714441 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 08:35:29.721479 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:35:30.242804 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 08:35:30.248800 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 08:35:30.260452 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 08:35:30.294223 tst assert_extension.py: using LAC 32744 08:35:30.414530 tst assert_extension.py: using RAC 104 08:35:30.535262 tst assert_extension.py: using CellId 32744 08:35:30.656237 tst assert_extension.py: using BVCI 32745 08:35:30.767370 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 08:35:30.887036 tst assert_extension.py:10: start nitb and bts... 08:35:31.112650 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:35:31.816029 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26375): Launched 08:35:32.160805 run osmo-nitb_10.42.42.2(pid=26376): Launched 08:35:32.362710 run osmo-nitb_10.42.42.2(pid=26376): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26376)] 08:35:32.509505 run osmo-nitb_10.42.42.2(pid=26376): stdout: | (launched: 2022-12-13_08:35:32.099685) 08:35:32.657753 run osmo-nitb_10.42.42.2(pid=26376): stderr: | (launched: 2022-12-13_08:35:32.149696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:35:32.805241 run osmo-nitb_10.42.42.2(pid=26376): stdout: | (launched: 2022-12-13_08:35:32.099685) 08:35:32.947165 run osmo-nitb_10.42.42.2(pid=26376): stderr: | (launched: 2022-12-13_08:35:32.149696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26376): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26376) [trial-2387↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26376)] 08:35:33.303889 tst osmo-nitb_10.42.42.2(pid=26376): stdout: | (launched: 2022-12-13_08:35:32.099685) 08:35:33.436577 tst osmo-nitb_10.42.42.2(pid=26376): stderr: | (launched: 2022-12-13_08:35:32.149696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:35:33.592366 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26376): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26376) [trial-2387↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26376)] [trial-2387↪nitb_ussd:sysmo↪assert_extension.py:12] 08:35:33.601367 tst assert_extension.py:12: Test FAILED (3.3 sec) 08:35:33.608508 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26375): Terminating (SIGTERM) 08:35:33.819365 --- ParallelTerminationStrategy: PID 26375 died... 08:35:33.841145 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26375): Terminated: ok {rc=0} 08:35:33.930009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:sysmo --------------------------------------------------------------------- 08:35:35.096083 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:35.100397 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:35:35.121197 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 08:35:35.148360 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:35:35.183860 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:35:35.205325 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 08:35:35.231779 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:35:35.761922 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:sysmo assert_extension.py ---------------------------------------------- 08:35:35.767327 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:35:35.779778 tst ussd:sysmo: Using 1 x bts (candidates: 1) 08:35:35.812801 tst assert_extension.py: using LAC 32745 08:35:35.935270 tst assert_extension.py: using RAC 105 08:35:36.063004 tst assert_extension.py: using CellId 32745 08:35:36.189401 tst assert_extension.py: using BVCI 32746 08:35:36.302247 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:35:36.312794 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:35:36.323416 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:35:36.333918 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:35:36.344347 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:35:36.356678 tst ussd:sysmo: Using 1 x modem (candidates: 1) 08:35:36.474184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:36.951917 run create_hlr_db(pid=26380): Launched 08:35:37.071209 bus /sierra_2: Setting Powered False 08:35:38.132008 run create_hlr_db(pid=26380): Terminated: ok {rc=0} 08:35:38.582326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26382): Launched 08:35:38.911515 run osmo-hlr_10.42.42.2(pid=26383): Launched 08:35:39.038455 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:39.611906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26385): Launched 08:35:39.940667 run osmo-stp_10.42.42.5(pid=26386): Launched 08:35:40.067671 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:40.662343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26388): Launched 08:35:40.993075 run osmo-msc_10.42.42.6(pid=26389): Launched 08:35:41.176807 run osmo-stp_10.42.42.5(pid=26386): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26386)] 08:35:41.315502 run osmo-stp_10.42.42.5(pid=26386): stdout: | (launched: 2022-12-13_08:35:39.879470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:41.454629 run osmo-stp_10.42.42.5(pid=26386): stderr: | 20221213083540077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083540077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083540077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083540078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083540078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083540078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083540078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:41.593264 run osmo-stp_10.42.42.5(pid=26386): stdout: | (launched: 2022-12-13_08:35:39.879470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:41.723961 run osmo-stp_10.42.42.5(pid=26386): stderr: | 20221213083540077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083540077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083540077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083540078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083540078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083540078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083540078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:41.880617 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26386): Process ended prematurely: osmo-stp_10.42.42.5(pid=26386) [trial-2387↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26386)] [trial-2387↪ussd:sysmo↪assert_extension.py:17] 08:35:41.889608 tst assert_extension.py:17: Test FAILED (6.1 sec) 08:35:41.916848 run osmo-hlr_10.42.42.2(pid=26383): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26383)] 08:35:41.967635 run osmo-hlr_10.42.42.2(pid=26383): stdout: | (launched: 2022-12-13_08:35:38.850279) 08:35:42.020312 run osmo-hlr_10.42.42.2(pid=26383): stderr: | 20221213083539052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083539052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083539052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083539052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083539052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083539052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083539065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083539075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083539075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083539075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:42.093547 run osmo-msc_10.42.42.6(pid=26389): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26389)] 08:35:42.144321 run osmo-msc_10.42.42.6(pid=26389): stdout: | (launched: 2022-12-13_08:35:40.931618) 08:35:42.197239 run osmo-msc_10.42.42.6(pid=26389): stderr: | 20221213083541256 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083541256 DLGLOBAL DEBUG validating counter group 0x7fd7caee4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083541256 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083541256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083541256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083541257 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083541258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083541259 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083541259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083541259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:42.250118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26382): Terminating (SIGTERM) 08:35:42.292614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26385): Terminating (SIGTERM) 08:35:42.335670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26388): Terminating (SIGTERM) 08:35:42.379109 --- ParallelTerminationStrategy: PID 26382 died... 08:35:42.399630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26382): Terminated: ok {rc=0} 08:35:42.446766 --- ParallelTerminationStrategy: PID 26385 died... 08:35:42.466793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26385): Terminated: ok {rc=0} 08:35:42.513395 --- ParallelTerminationStrategy: PID 26388 died... 08:35:42.533098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26388): Terminated: ok {rc=0} 08:35:42.621375 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:35:43.823993 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:43.831661 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:35:43.853236 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:35:43.882881 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:35:43.939765 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:35:43.961963 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:35:43.990001 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:35:44.538868 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:35:44.594647 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:44.606273 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:35:44.664867 tst mo_mt_call.py: using LAC 32746 08:35:44.796043 tst mo_mt_call.py: using RAC 106 08:35:44.945074 tst mo_mt_call.py: using CellId 32746 08:35:45.075100 tst mo_mt_call.py: using BVCI 32747 08:35:45.198409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:45.210097 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:45.221573 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:45.232838 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:45.245074 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:45.257086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:35:45.377138 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:35:45.500254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:46.004762 run create_hlr_db(pid=26394): Launched 08:35:46.203061 bus /sierra_2: Setting Powered False 08:35:47.268938 run create_hlr_db(pid=26394): Terminated: ok {rc=0} 08:35:47.737108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26396): Launched 08:35:48.072473 run osmo-hlr_10.42.42.2(pid=26397): Launched 08:35:48.202189 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:48.778031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26399): Launched 08:35:49.113680 run osmo-stp_10.42.42.5(pid=26400): Launched 08:35:49.240532 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:49.844377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26402): Launched 08:35:50.213633 run osmo-msc_10.42.42.6(pid=26403): Launched 08:35:50.399863 run osmo-stp_10.42.42.5(pid=26400): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26400)] 08:35:50.539553 run osmo-stp_10.42.42.5(pid=26400): stdout: | (launched: 2022-12-13_08:35:49.051520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:50.679990 run osmo-stp_10.42.42.5(pid=26400): stderr: | 20221213083549249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083549249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083549249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083549250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083549250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083549250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083549250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:50.818791 run osmo-stp_10.42.42.5(pid=26400): stdout: | (launched: 2022-12-13_08:35:49.051520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:50.951163 run osmo-stp_10.42.42.5(pid=26400): stderr: | 20221213083549249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083549249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083549249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083549250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083549250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083549250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083549250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:51.109768 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26400): Process ended prematurely: osmo-stp_10.42.42.5(pid=26400) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26400)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:35:51.119235 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:35:51.146934 run osmo-hlr_10.42.42.2(pid=26397): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26397)] 08:35:51.197743 run osmo-hlr_10.42.42.2(pid=26397): stdout: | (launched: 2022-12-13_08:35:48.010703) 08:35:51.250185 run osmo-hlr_10.42.42.2(pid=26397): stderr: | 20221213083548212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083548212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083548212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083548212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083548212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083548212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083548224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083548233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083548233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083548233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:51.322828 run osmo-msc_10.42.42.6(pid=26403): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26403)] 08:35:51.373330 run osmo-msc_10.42.42.6(pid=26403): stdout: | (launched: 2022-12-13_08:35:50.150931) 08:35:51.425493 run osmo-msc_10.42.42.6(pid=26403): stderr: | 20221213083550477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083550477 DLGLOBAL DEBUG validating counter group 0x7f306fd27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083550477 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083550477 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083550477 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083550478 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083550479 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083550480 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083550480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083550480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:51.478005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26396): Terminating (SIGTERM) 08:35:51.519956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26399): Terminating (SIGTERM) 08:35:51.562221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26402): Terminating (SIGTERM) 08:35:51.604803 --- ParallelTerminationStrategy: PID 26396 died... 08:35:51.625180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26396): Terminated: ok {rc=0} 08:35:51.671588 --- ParallelTerminationStrategy: PID 26399 died... 08:35:51.691271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26399): Terminated: ok {rc=0} 08:35:51.738121 --- ParallelTerminationStrategy: PID 26402 died... 08:35:51.757968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26402): Terminated: ok {rc=0} 08:35:51.848538 bus /sierra_3: Setting Powered False 08:35:52.954143 bus /sierra_3: Setting Powered False 08:35:54.070316 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:35:55.223408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:55.235634 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:35:55.294000 tst mo_mt_call_osmux.py: using LAC 32747 08:35:55.566478 tst mo_mt_call_osmux.py: using RAC 107 08:35:55.713787 tst mo_mt_call_osmux.py: using CellId 32747 08:35:55.844352 tst mo_mt_call_osmux.py: using BVCI 32748 08:35:55.964651 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:55.976341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:55.987837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:55.999238 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:56.010789 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:35:56.022290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:35:56.144684 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:35:56.264876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:56.751768 run create_hlr_db(pid=26406): Launched 08:35:56.873245 bus /sierra_2: Setting Powered False 08:35:57.935415 run create_hlr_db(pid=26406): Terminated: ok {rc=0} 08:35:58.394470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26408): Launched 08:35:58.732000 run osmo-hlr_10.42.42.2(pid=26409): Launched 08:35:58.861709 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:59.439126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26411): Launched 08:35:59.775124 run osmo-stp_10.42.42.5(pid=26412): Launched 08:35:59.904158 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:00.510016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26414): Launched 08:36:00.846540 run osmo-msc_10.42.42.6(pid=26415): Launched 08:36:01.038422 run osmo-stp_10.42.42.5(pid=26412): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26412)] 08:36:01.225783 run osmo-stp_10.42.42.5(pid=26412): stdout: | (launched: 2022-12-13_08:35:59.713022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:01.436487 run osmo-stp_10.42.42.5(pid=26412): stderr: | 20221213083559911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083559912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083559912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083559912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083559913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083559913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083559913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:01.803895 run osmo-stp_10.42.42.5(pid=26412): stdout: | (launched: 2022-12-13_08:35:59.713022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:01.993261 run osmo-stp_10.42.42.5(pid=26412): stderr: | 20221213083559911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083559912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083559912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083559912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083559913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083559913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083559913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:02.156222 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26412): Process ended prematurely: osmo-stp_10.42.42.5(pid=26412) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26412)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:36:02.166745 tst mo_mt_call_osmux.py:8: Test FAILED (7.0 sec) 08:36:02.195628 run osmo-hlr_10.42.42.2(pid=26409): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26409)] 08:36:02.249230 run osmo-hlr_10.42.42.2(pid=26409): stdout: | (launched: 2022-12-13_08:35:58.669727) 08:36:02.303949 run osmo-hlr_10.42.42.2(pid=26409): stderr: | 20221213083558871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083558871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083558871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083558871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083558871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083558871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083558917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083558927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083558927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083558927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:02.378778 run osmo-msc_10.42.42.6(pid=26415): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26415)] 08:36:02.430637 run osmo-msc_10.42.42.6(pid=26415): stdout: | (launched: 2022-12-13_08:36:00.784115) 08:36:02.485436 run osmo-msc_10.42.42.6(pid=26415): stderr: | 20221213083601405 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083601406 DLGLOBAL DEBUG validating counter group 0x7f2118e3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083601407 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083601407 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083601408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083601409 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083601418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083601421 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083601421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083601421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:02.538666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26408): Terminating (SIGTERM) 08:36:02.580379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26411): Terminating (SIGTERM) 08:36:02.621862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26414): Terminating (SIGTERM) 08:36:02.662379 --- ParallelTerminationStrategy: PID 26408 died... 08:36:02.682187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26408): Terminated: ok {rc=0} 08:36:02.726977 --- ParallelTerminationStrategy: PID 26411 died... 08:36:02.746261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26411): Terminated: ok {rc=0} 08:36:02.790731 --- ParallelTerminationStrategy: PID 26414 died... 08:36:02.809772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26414): Terminated: ok {rc=0} 08:36:02.896609 bus /sierra_3: Setting Powered False 08:36:03.995438 bus /sierra_3: Setting Powered False 08:36:05.108556 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:36:06.348559 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:06.355714 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:36:06.376414 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:36:06.406630 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:36:06.459345 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:36:06.480856 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:36:06.508443 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:36:07.062587 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:36:07.113489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:07.124506 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:36:07.182437 tst mo_mt_call.py: using LAC 32748 08:36:07.314279 tst mo_mt_call.py: using RAC 108 08:36:07.446520 tst mo_mt_call.py: using CellId 32748 08:36:07.579686 tst mo_mt_call.py: using BVCI 32749 08:36:07.703298 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:07.715146 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:07.726510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:07.737920 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:07.749289 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:07.760615 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:07.881979 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:08.004220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:08.525127 run create_hlr_db(pid=26420): Launched 08:36:08.662210 bus /sierra_2: Setting Powered False 08:36:09.728726 run create_hlr_db(pid=26420): Terminated: ok {rc=0} 08:36:10.175434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26422): Launched 08:36:10.492029 run osmo-hlr_10.42.42.2(pid=26423): Launched 08:36:10.613685 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:11.169886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26425): Launched 08:36:11.486108 run osmo-stp_10.42.42.5(pid=26426): Launched 08:36:11.608350 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:12.176224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26428): Launched 08:36:12.494279 run osmo-msc_10.42.42.6(pid=26429): Launched 08:36:12.673615 run osmo-stp_10.42.42.5(pid=26426): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26426)] 08:36:12.806807 run osmo-stp_10.42.42.5(pid=26426): stdout: | (launched: 2022-12-13_08:36:11.427141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:12.939605 run osmo-stp_10.42.42.5(pid=26426): stderr: | 20221213083611603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083611603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083611604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083611604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083611604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083611605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083611605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:13.069366 run osmo-stp_10.42.42.5(pid=26426): stdout: | (launched: 2022-12-13_08:36:11.427141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:13.194280 run osmo-stp_10.42.42.5(pid=26426): stderr: | 20221213083611603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083611603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083611604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083611604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083611604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083611605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083611605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:13.343030 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26426): Process ended prematurely: osmo-stp_10.42.42.5(pid=26426) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26426)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:36:13.351854 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:36:13.377841 run osmo-hlr_10.42.42.2(pid=26423): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26423)] 08:36:13.426794 run osmo-hlr_10.42.42.2(pid=26423): stdout: | (launched: 2022-12-13_08:36:10.433392) 08:36:13.476311 run osmo-hlr_10.42.42.2(pid=26423): stderr: | 20221213083610612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083610612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083610612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083610612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083610613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083610613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083610625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083610633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083610633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083610633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:13.545556 run osmo-msc_10.42.42.6(pid=26429): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26429)] 08:36:13.592906 run osmo-msc_10.42.42.6(pid=26429): stdout: | (launched: 2022-12-13_08:36:12.435369) 08:36:13.642439 run osmo-msc_10.42.42.6(pid=26429): stderr: | 20221213083612711 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083612712 DLGLOBAL DEBUG validating counter group 0x7fe9759f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083612712 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083612712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083612712 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083612712 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083612714 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083612714 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083612715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083612715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:13.692448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26422): Terminating (SIGTERM) 08:36:13.732275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26425): Terminating (SIGTERM) 08:36:13.772402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26428): Terminating (SIGTERM) 08:36:13.812609 --- ParallelTerminationStrategy: PID 26422 died... 08:36:13.832034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26422): Terminated: ok {rc=0} 08:36:13.876073 --- ParallelTerminationStrategy: PID 26425 died... 08:36:13.894852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26425): Terminated: ok {rc=0} 08:36:13.938974 --- ParallelTerminationStrategy: PID 26428 died... 08:36:13.957861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26428): Terminated: ok {rc=0} 08:36:14.044467 bus /sierra_3: Setting Powered False 08:36:15.145780 bus /sierra_3: Setting Powered False 08:36:16.264774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:36:17.420014 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:17.432253 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:36:17.489932 tst mo_mt_call_osmux.py: using LAC 32749 08:36:17.620594 tst mo_mt_call_osmux.py: using RAC 109 08:36:17.751545 tst mo_mt_call_osmux.py: using CellId 32749 08:36:17.883488 tst mo_mt_call_osmux.py: using BVCI 32750 08:36:18.006363 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:18.018052 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:18.029465 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:18.040816 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:18.052216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:18.063668 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:18.183090 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:18.306300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:18.826360 run create_hlr_db(pid=26431): Launched 08:36:18.964144 bus /sierra_2: Setting Powered False 08:36:20.029379 run create_hlr_db(pid=26431): Terminated: ok {rc=0} 08:36:20.477122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26433): Launched 08:36:20.794384 run osmo-hlr_10.42.42.2(pid=26434): Launched 08:36:20.916490 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:21.466993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26436): Launched 08:36:21.783200 run osmo-stp_10.42.42.5(pid=26437): Launched 08:36:21.905136 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:22.481118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26439): Launched 08:36:22.796792 run osmo-msc_10.42.42.6(pid=26440): Launched 08:36:22.971626 run osmo-stp_10.42.42.5(pid=26437): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26437)] 08:36:23.105084 run osmo-stp_10.42.42.5(pid=26437): stdout: | (launched: 2022-12-13_08:36:21.724286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:23.237522 run osmo-stp_10.42.42.5(pid=26437): stderr: | 20221213083621949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083621949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083621949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083621950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083621950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083621950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083621950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:23.367753 run osmo-stp_10.42.42.5(pid=26437): stdout: | (launched: 2022-12-13_08:36:21.724286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:23.492310 run osmo-stp_10.42.42.5(pid=26437): stderr: | 20221213083621949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083621949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083621949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083621950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083621950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083621950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083621950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:23.641643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26437): Process ended prematurely: osmo-stp_10.42.42.5(pid=26437) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26437)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:36:23.650642 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:36:23.677088 run osmo-hlr_10.42.42.2(pid=26434): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26434)] 08:36:23.725628 run osmo-hlr_10.42.42.2(pid=26434): stdout: | (launched: 2022-12-13_08:36:20.735609) 08:36:23.775645 run osmo-hlr_10.42.42.2(pid=26434): stderr: | 20221213083620915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083620915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083620915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083620915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083620915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083620915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083620928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083620938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083620938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083620938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:23.845902 run osmo-msc_10.42.42.6(pid=26440): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26440)] 08:36:23.893822 run osmo-msc_10.42.42.6(pid=26440): stdout: | (launched: 2022-12-13_08:36:22.737948) 08:36:23.943644 run osmo-msc_10.42.42.6(pid=26440): stderr: | 20221213083623013 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083623013 DLGLOBAL DEBUG validating counter group 0x7f118a9afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083623014 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083623014 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083623014 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083623014 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083623016 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083623016 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083623016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083623016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:23.993859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26433): Terminating (SIGTERM) 08:36:24.034028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26436): Terminating (SIGTERM) 08:36:24.074334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26439): Terminating (SIGTERM) 08:36:24.114830 --- ParallelTerminationStrategy: PID 26433 died... 08:36:24.134678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26433): Terminated: ok {rc=0} 08:36:24.179442 --- ParallelTerminationStrategy: PID 26436 died... 08:36:24.198276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26436): Terminated: ok {rc=0} 08:36:24.242785 --- ParallelTerminationStrategy: PID 26439 died... 08:36:24.261877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26439): Terminated: ok {rc=0} 08:36:24.348302 bus /sierra_3: Setting Powered False 08:36:25.448015 bus /sierra_3: Setting Powered False 08:36:26.562699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:36:27.796264 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:27.802598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:36:27.823328 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:36:27.851050 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:36:27.903126 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:36:27.923850 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:36:27.950675 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:36:28.500082 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:36:28.555160 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:28.566883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:36:28.625080 tst mo_mt_call.py: using LAC 32750 08:36:28.757012 tst mo_mt_call.py: using RAC 110 08:36:28.888357 tst mo_mt_call.py: using CellId 32750 08:36:29.020333 tst mo_mt_call.py: using BVCI 32751 08:36:29.141705 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:29.153460 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:29.164786 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:29.176115 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:29.187475 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:29.198991 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:36:29.319699 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:36:29.441667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:29.962687 run create_hlr_db(pid=26445): Launched 08:36:30.098298 bus /sierra_2: Setting Powered False 08:36:31.159025 run create_hlr_db(pid=26445): Terminated: ok {rc=0} 08:36:31.696885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26447): Launched 08:36:32.054549 run osmo-hlr_10.42.42.2(pid=26448): Launched 08:36:32.302580 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:32.862526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26450): Launched 08:36:33.179083 run osmo-stp_10.42.42.5(pid=26451): Launched 08:36:33.300807 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:33.871772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26453): Launched 08:36:34.188559 run osmo-msc_10.42.42.6(pid=26454): Launched 08:36:34.367597 run osmo-stp_10.42.42.5(pid=26451): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26451)] 08:36:34.500939 run osmo-stp_10.42.42.5(pid=26451): stdout: | (launched: 2022-12-13_08:36:33.120077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:34.633512 run osmo-stp_10.42.42.5(pid=26451): stderr: | 20221213083633296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083633296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083633297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083633297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083633298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083633298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083633298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:34.764448 run osmo-stp_10.42.42.5(pid=26451): stdout: | (launched: 2022-12-13_08:36:33.120077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:34.888856 run osmo-stp_10.42.42.5(pid=26451): stderr: | 20221213083633296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083633296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083633297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083633297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083633298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083633298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083633298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:35.038241 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26451): Process ended prematurely: osmo-stp_10.42.42.5(pid=26451) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26451)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:36:35.046960 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:36:35.073390 run osmo-hlr_10.42.42.2(pid=26448): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26448)] 08:36:35.122061 run osmo-hlr_10.42.42.2(pid=26448): stdout: | (launched: 2022-12-13_08:36:31.991958) 08:36:35.172149 run osmo-hlr_10.42.42.2(pid=26448): stderr: | 20221213083632241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083632241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083632241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083632241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083632241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083632242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083632256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083632271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083632271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083632271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:35.241961 run osmo-msc_10.42.42.6(pid=26454): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26454)] 08:36:35.289717 run osmo-msc_10.42.42.6(pid=26454): stdout: | (launched: 2022-12-13_08:36:34.129789) 08:36:35.339457 run osmo-msc_10.42.42.6(pid=26454): stderr: | 20221213083634405 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083634405 DLGLOBAL DEBUG validating counter group 0x7f1d8b200c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083634405 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083634405 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083634406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083634406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083634407 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083634408 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083634408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083634408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:35.389760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26447): Terminating (SIGTERM) 08:36:35.429419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26450): Terminating (SIGTERM) 08:36:35.469053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26453): Terminating (SIGTERM) 08:36:35.508766 --- ParallelTerminationStrategy: PID 26447 died... 08:36:35.528214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26447): Terminated: ok {rc=0} 08:36:35.572456 --- ParallelTerminationStrategy: PID 26450 died... 08:36:35.591439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26450): Terminated: ok {rc=0} 08:36:35.636055 --- ParallelTerminationStrategy: PID 26453 died... 08:36:35.655077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26453): Terminated: ok {rc=0} 08:36:35.740569 bus /sierra_3: Setting Powered False 08:36:36.838546 bus /sierra_3: Setting Powered False 08:36:37.958952 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:36:39.107101 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:39.119059 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:36:39.176079 tst mo_mt_call_osmux.py: using LAC 32751 08:36:39.300087 tst mo_mt_call_osmux.py: using RAC 111 08:36:39.424099 tst mo_mt_call_osmux.py: using CellId 32751 08:36:39.548032 tst mo_mt_call_osmux.py: using BVCI 32752 08:36:39.663249 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:39.674410 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:39.685465 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:39.696296 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:39.707474 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:39.718841 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:36:39.841890 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:36:39.960494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:40.447047 run create_hlr_db(pid=26456): Launched 08:36:40.567486 bus /sierra_2: Setting Powered False 08:36:41.629441 run create_hlr_db(pid=26456): Terminated: ok {rc=0} 08:36:42.090216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26459): Launched 08:36:42.428130 run osmo-hlr_10.42.42.2(pid=26460): Launched 08:36:42.558645 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:43.136594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26462): Launched 08:36:43.477743 run osmo-stp_10.42.42.5(pid=26463): Launched 08:36:43.613024 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:44.219301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26465): Launched 08:36:44.556289 run osmo-msc_10.42.42.6(pid=26466): Launched 08:36:44.745238 run osmo-stp_10.42.42.5(pid=26463): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26463)] 08:36:44.885652 run osmo-stp_10.42.42.5(pid=26463): stdout: | (launched: 2022-12-13_08:36:43.411573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:45.026528 run osmo-stp_10.42.42.5(pid=26463): stderr: | 20221213083643612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083643612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083643612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083643613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083643613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083643613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083643613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:45.166572 run osmo-stp_10.42.42.5(pid=26463): stdout: | (launched: 2022-12-13_08:36:43.411573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:45.300651 run osmo-stp_10.42.42.5(pid=26463): stderr: | 20221213083643612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083643612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083643612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083643613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083643613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083643613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083643613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:45.460505 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26463): Process ended prematurely: osmo-stp_10.42.42.5(pid=26463) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26463)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:36:45.470366 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:36:45.498371 run osmo-hlr_10.42.42.2(pid=26460): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26460)] 08:36:45.549636 run osmo-hlr_10.42.42.2(pid=26460): stdout: | (launched: 2022-12-13_08:36:42.365852) 08:36:45.602542 run osmo-hlr_10.42.42.2(pid=26460): stderr: | 20221213083642566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083642566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083642566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083642566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083642566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083642566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083642577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083642586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083642586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083642586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:45.676622 run osmo-msc_10.42.42.6(pid=26466): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26466)] 08:36:45.727703 run osmo-msc_10.42.42.6(pid=26466): stdout: | (launched: 2022-12-13_08:36:44.493796) 08:36:45.780649 run osmo-msc_10.42.42.6(pid=26466): stderr: | 20221213083644820 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083644820 DLGLOBAL DEBUG validating counter group 0x7fdf4c5fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083644820 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083644820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083644820 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083644821 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083644822 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083644823 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083644823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083644823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:45.833803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26459): Terminating (SIGTERM) 08:36:45.876513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26462): Terminating (SIGTERM) 08:36:45.919261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26465): Terminating (SIGTERM) 08:36:45.967418 --- ParallelTerminationStrategy: PID 26459 died... 08:36:45.988548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26459): Terminated: ok {rc=0} 08:36:46.038038 --- ParallelTerminationStrategy: PID 26462 died... 08:36:46.059170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26462): Terminated: ok {rc=0} 08:36:46.107003 --- ParallelTerminationStrategy: PID 26465 died... 08:36:46.128099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26465): Terminated: ok {rc=0} 08:36:46.221945 bus /sierra_3: Setting Powered False 08:36:47.324530 bus /sierra_3: Setting Powered False 08:36:48.448437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:36:49.692537 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:49.699711 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:36:49.721153 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:36:49.749256 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:36:49.812185 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:36:49.833914 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:36:49.859994 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:36:50.414609 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:36:50.469717 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:36:50.481401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:36:50.540853 tst mo_mt_call.py: using LAC 32752 08:36:50.672070 tst mo_mt_call.py: using RAC 112 08:36:50.801742 tst mo_mt_call.py: using CellId 32752 08:36:50.930764 tst mo_mt_call.py: using BVCI 32753 08:36:51.051972 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:36:51.063596 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:36:51.074981 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:36:51.086428 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:36:51.097835 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:36:51.109253 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:36:51.230565 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:36:51.352604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:51.872296 run create_hlr_db(pid=26471): Launched 08:36:52.009845 bus /sierra_2: Setting Powered False 08:36:53.075776 run create_hlr_db(pid=26471): Terminated: ok {rc=0} 08:36:53.523565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26473): Launched 08:36:53.861319 run osmo-hlr_10.42.42.2(pid=26474): Launched 08:36:53.988140 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:54.565355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26476): Launched 08:36:54.901894 run osmo-stp_10.42.42.5(pid=26477): Launched 08:36:55.029001 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:55.634750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26479): Launched 08:36:55.971384 run osmo-msc_10.42.42.6(pid=26480): Launched 08:36:56.159940 run osmo-stp_10.42.42.5(pid=26477): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26477)] 08:36:56.300273 run osmo-stp_10.42.42.5(pid=26477): stdout: | (launched: 2022-12-13_08:36:54.839529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:56.440371 run osmo-stp_10.42.42.5(pid=26477): stderr: | 20221213083655035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083655035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083655035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083655036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083655038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083655038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083655038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:56.579649 run osmo-stp_10.42.42.5(pid=26477): stdout: | (launched: 2022-12-13_08:36:54.839529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:56.713031 run osmo-stp_10.42.42.5(pid=26477): stderr: | 20221213083655035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083655035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083655035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083655036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083655038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083655038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083655038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:56.872208 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26477): Process ended prematurely: osmo-stp_10.42.42.5(pid=26477) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26477)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:36:56.882073 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:36:56.909868 run osmo-hlr_10.42.42.2(pid=26474): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26474)] 08:36:56.960602 run osmo-hlr_10.42.42.2(pid=26474): stdout: | (launched: 2022-12-13_08:36:53.799358) 08:36:57.013246 run osmo-hlr_10.42.42.2(pid=26474): stderr: | 20221213083654000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083654000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083654000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083654000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083654000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083654000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083654012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083654022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083654022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083654022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:57.086165 run osmo-msc_10.42.42.6(pid=26480): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26480)] 08:36:57.136602 run osmo-msc_10.42.42.6(pid=26480): stdout: | (launched: 2022-12-13_08:36:55.908936) 08:36:57.188858 run osmo-msc_10.42.42.6(pid=26480): stderr: | 20221213083656235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083656235 DLGLOBAL DEBUG validating counter group 0x7fc382dd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083656235 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083656235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083656235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083656236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083656237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083656238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083656238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083656238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:57.241940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26473): Terminating (SIGTERM) 08:36:57.284075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26476): Terminating (SIGTERM) 08:36:57.326279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26479): Terminating (SIGTERM) 08:36:57.368599 --- ParallelTerminationStrategy: PID 26473 died... 08:36:57.389057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26473): Terminated: ok {rc=0} 08:36:57.435712 --- ParallelTerminationStrategy: PID 26476 died... 08:36:57.455521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26476): Terminated: ok {rc=0} 08:36:57.502391 --- ParallelTerminationStrategy: PID 26479 died... 08:36:57.522309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26479): Terminated: ok {rc=0} 08:36:57.611550 bus /sierra_3: Setting Powered False 08:36:58.710460 bus /sierra_3: Setting Powered False 08:36:59.827036 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:37:00.988660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:01.001826 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:37:01.063727 tst mo_mt_call_osmux.py: using LAC 32753 08:37:01.195690 tst mo_mt_call_osmux.py: using RAC 113 08:37:01.332138 tst mo_mt_call_osmux.py: using CellId 32753 08:37:01.486362 tst mo_mt_call_osmux.py: using BVCI 32754 08:37:01.606527 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:01.618087 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:01.629452 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:01.640511 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:01.654476 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:01.667544 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:37:01.789584 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:37:01.914113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:02.423389 run create_hlr_db(pid=26482): Launched 08:37:02.559252 bus /sierra_2: Setting Powered False 08:37:03.621365 run create_hlr_db(pid=26482): Terminated: ok {rc=0} 08:37:04.078860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26484): Launched 08:37:04.417890 run osmo-hlr_10.42.42.2(pid=26485): Launched 08:37:04.546183 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:05.125870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26487): Launched 08:37:05.462085 run osmo-stp_10.42.42.5(pid=26488): Launched 08:37:05.590295 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:06.195969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26490): Launched 08:37:06.532939 run osmo-msc_10.42.42.6(pid=26491): Launched 08:37:06.720801 run osmo-stp_10.42.42.5(pid=26488): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26488)] 08:37:06.860808 run osmo-stp_10.42.42.5(pid=26488): stdout: | (launched: 2022-12-13_08:37:05.399700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:07.001382 run osmo-stp_10.42.42.5(pid=26488): stderr: | 20221213083705597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083705597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083705598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083705598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083705599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083705599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083705599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:07.140716 run osmo-stp_10.42.42.5(pid=26488): stdout: | (launched: 2022-12-13_08:37:05.399700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:07.274966 run osmo-stp_10.42.42.5(pid=26488): stderr: | 20221213083705597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083705597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083705598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083705598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083705599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083705599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083705599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:07.434582 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26488): Process ended prematurely: osmo-stp_10.42.42.5(pid=26488) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26488)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:37:07.444422 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:37:07.472508 run osmo-hlr_10.42.42.2(pid=26485): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26485)] 08:37:07.523612 run osmo-hlr_10.42.42.2(pid=26485): stdout: | (launched: 2022-12-13_08:37:04.355333) 08:37:07.576201 run osmo-hlr_10.42.42.2(pid=26485): stderr: | 20221213083704558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083704558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083704558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083704558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083704558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083704558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083704570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083704579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083704579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083704579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:07.649324 run osmo-msc_10.42.42.6(pid=26491): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26491)] 08:37:07.699987 run osmo-msc_10.42.42.6(pid=26491): stdout: | (launched: 2022-12-13_08:37:06.470625) 08:37:07.752252 run osmo-msc_10.42.42.6(pid=26491): stderr: | 20221213083706799 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083706800 DLGLOBAL DEBUG validating counter group 0x7f8ae7d2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083706800 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083706800 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083706800 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083706800 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083706802 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083706802 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083706802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083706803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:07.804655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26484): Terminating (SIGTERM) 08:37:07.846741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26487): Terminating (SIGTERM) 08:37:07.889019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26490): Terminating (SIGTERM) 08:37:07.931368 --- ParallelTerminationStrategy: PID 26484 died... 08:37:07.951934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26484): Terminated: ok {rc=0} 08:37:07.998970 --- ParallelTerminationStrategy: PID 26487 died... 08:37:08.018839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26487): Terminated: ok {rc=0} 08:37:08.065694 --- ParallelTerminationStrategy: PID 26490 died... 08:37:08.085755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26490): Terminated: ok {rc=0} 08:37:08.174558 bus /sierra_3: Setting Powered False 08:37:09.272868 bus /sierra_3: Setting Powered False 08:37:10.389051 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:37:11.628316 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:11.635809 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:37:11.656896 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:37:11.684341 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:37:11.739471 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:37:11.761329 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:37:11.788567 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:37:12.338004 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:37:12.389769 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:12.404373 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:37:12.462817 tst mo_mt_call.py: using LAC 32754 08:37:12.595923 tst mo_mt_call.py: using RAC 114 08:37:12.728625 tst mo_mt_call.py: using CellId 32754 08:37:12.861025 tst mo_mt_call.py: using BVCI 32755 08:37:12.982567 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:12.994406 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:13.005798 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:13.017056 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:13.028382 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:13.039782 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:13.162376 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:13.280638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:13.768217 run create_hlr_db(pid=26496): Launched 08:37:13.890996 bus /sierra_2: Setting Powered False 08:37:14.953395 run create_hlr_db(pid=26496): Terminated: ok {rc=0} 08:37:15.392074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26498): Launched 08:37:15.709159 run osmo-hlr_10.42.42.2(pid=26499): Launched 08:37:15.830382 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:16.388313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26501): Launched 08:37:16.721747 run osmo-stp_10.42.42.5(pid=26502): Launched 08:37:16.904330 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:17.667694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26504): Launched 08:37:17.985384 run osmo-msc_10.42.42.6(pid=26505): Launched 08:37:18.161992 run osmo-stp_10.42.42.5(pid=26502): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26502)] 08:37:18.296279 run osmo-stp_10.42.42.5(pid=26502): stdout: | (launched: 2022-12-13_08:37:16.661909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:18.429906 run osmo-stp_10.42.42.5(pid=26502): stderr: | 20221213083717020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083717020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083717020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083717020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083717029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083717029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083717029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:18.560861 run osmo-stp_10.42.42.5(pid=26502): stdout: | (launched: 2022-12-13_08:37:16.661909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:18.686570 run osmo-stp_10.42.42.5(pid=26502): stderr: | 20221213083717020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083717020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083717020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083717020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083717029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083717029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083717029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:18.836533 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26502): Process ended prematurely: osmo-stp_10.42.42.5(pid=26502) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26502)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:37:18.845689 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:37:18.872376 run osmo-hlr_10.42.42.2(pid=26499): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26499)] 08:37:18.921501 run osmo-hlr_10.42.42.2(pid=26499): stdout: | (launched: 2022-12-13_08:37:15.650220) 08:37:18.971964 run osmo-hlr_10.42.42.2(pid=26499): stderr: | 20221213083715830 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083715830 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083715830 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083715830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083715830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083715830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083715842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083715850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083715851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083715851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:19.042454 run osmo-msc_10.42.42.6(pid=26505): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26505)] 08:37:19.090649 run osmo-msc_10.42.42.6(pid=26505): stdout: | (launched: 2022-12-13_08:37:17.926576) 08:37:19.142136 run osmo-msc_10.42.42.6(pid=26505): stderr: | 20221213083718203 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083718203 DLGLOBAL DEBUG validating counter group 0x7fc38e45dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083718203 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083718203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083718203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083718203 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083718205 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083718206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083718206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083718206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:19.193078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26498): Terminating (SIGTERM) 08:37:19.234047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26501): Terminating (SIGTERM) 08:37:19.274878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26504): Terminating (SIGTERM) 08:37:19.315942 --- ParallelTerminationStrategy: PID 26498 died... 08:37:19.336053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26498): Terminated: ok {rc=0} 08:37:19.381330 --- ParallelTerminationStrategy: PID 26501 died... 08:37:19.400823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26501): Terminated: ok {rc=0} 08:37:19.446015 --- ParallelTerminationStrategy: PID 26504 died... 08:37:19.465542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26504): Terminated: ok {rc=0} 08:37:19.553691 bus /sierra_3: Setting Powered False 08:37:20.653850 bus /sierra_3: Setting Powered False 08:37:21.770728 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:37:22.919868 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:22.931801 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:37:22.989081 tst mo_mt_call_osmux.py: using LAC 32755 08:37:23.113925 tst mo_mt_call_osmux.py: using RAC 115 08:37:23.246705 tst mo_mt_call_osmux.py: using CellId 32755 08:37:23.370758 tst mo_mt_call_osmux.py: using BVCI 32756 08:37:23.486001 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:23.497457 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:23.508567 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:23.519634 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:23.531349 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:23.543012 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:23.662010 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:23.788476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:24.307623 run create_hlr_db(pid=26507): Launched 08:37:24.446180 bus /sierra_2: Setting Powered False 08:37:25.511441 run create_hlr_db(pid=26507): Terminated: ok {rc=0} 08:37:25.974979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26509): Launched 08:37:26.309954 run osmo-hlr_10.42.42.2(pid=26510): Launched 08:37:26.438730 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:27.013638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26512): Launched 08:37:27.350738 run osmo-stp_10.42.42.5(pid=26513): Launched 08:37:27.477547 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:28.083579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26515): Launched 08:37:28.419977 run osmo-msc_10.42.42.6(pid=26516): Launched 08:37:28.606877 run osmo-stp_10.42.42.5(pid=26513): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26513)] 08:37:28.747213 run osmo-stp_10.42.42.5(pid=26513): stdout: | (launched: 2022-12-13_08:37:27.288259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:28.887742 run osmo-stp_10.42.42.5(pid=26513): stderr: | 20221213083727485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083727486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083727486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083727486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083727488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083727489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083727489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:29.027155 run osmo-stp_10.42.42.5(pid=26513): stdout: | (launched: 2022-12-13_08:37:27.288259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:29.160044 run osmo-stp_10.42.42.5(pid=26513): stderr: | 20221213083727485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083727486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083727486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083727486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083727488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083727489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083727489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:29.319720 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26513): Process ended prematurely: osmo-stp_10.42.42.5(pid=26513) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26513)] [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:37:29.329998 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:37:29.357631 run osmo-hlr_10.42.42.2(pid=26510): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26510)] 08:37:29.407692 run osmo-hlr_10.42.42.2(pid=26510): stdout: | (launched: 2022-12-13_08:37:26.247555) 08:37:29.459393 run osmo-hlr_10.42.42.2(pid=26510): stderr: | 20221213083726451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083726451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083726451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083726451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083726451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083726452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083726479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083726490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083726490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083726490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:29.531896 run osmo-msc_10.42.42.6(pid=26516): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26516)] 08:37:29.581977 run osmo-msc_10.42.42.6(pid=26516): stdout: | (launched: 2022-12-13_08:37:28.357790) 08:37:29.633738 run osmo-msc_10.42.42.6(pid=26516): stderr: | 20221213083728687 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083728687 DLGLOBAL DEBUG validating counter group 0x7f2de1092c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083728687 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083728687 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083728687 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083728687 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083728689 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083728689 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083728690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083728690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:29.685719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26509): Terminating (SIGTERM) 08:37:29.727221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26512): Terminating (SIGTERM) 08:37:29.768828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26515): Terminating (SIGTERM) 08:37:29.810722 --- ParallelTerminationStrategy: PID 26509 died... 08:37:29.830690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26509): Terminated: ok {rc=0} 08:37:29.876909 --- ParallelTerminationStrategy: PID 26512 died... 08:37:29.897133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26512): Terminated: ok {rc=0} 08:37:29.943523 --- ParallelTerminationStrategy: PID 26515 died... 08:37:29.963778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26515): Terminated: ok {rc=0} 08:37:30.052273 bus /sierra_3: Setting Powered False 08:37:31.150744 bus /sierra_3: Setting Powered False 08:37:32.269723 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:37:33.510432 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:33.517385 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:37:33.538583 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:37:33.566007 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:37:33.619748 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:37:33.641166 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:37:33.668872 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:37:34.217487 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:37:34.269811 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:34.281115 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:37:34.338438 tst mo_mt_call.py: using LAC 32756 08:37:34.467101 tst mo_mt_call.py: using RAC 116 08:37:34.589298 tst mo_mt_call.py: using CellId 32756 08:37:34.711548 tst mo_mt_call.py: using BVCI 32757 08:37:34.827404 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:34.838603 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:34.849709 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:34.860657 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:34.872419 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:34.884410 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:37:35.008159 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:37:35.129091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:35.651112 run create_hlr_db(pid=26523): Launched 08:37:35.788887 bus /sierra_2: Setting Powered False 08:37:36.855194 run create_hlr_db(pid=26523): Terminated: ok {rc=0} 08:37:37.303809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26525): Launched 08:37:37.621602 run osmo-hlr_10.42.42.2(pid=26526): Launched 08:37:37.744059 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:38.289631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26528): Launched 08:37:38.604836 run osmo-stp_10.42.42.5(pid=26529): Launched 08:37:38.733664 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:39.299721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26531): Launched 08:37:39.616327 run osmo-msc_10.42.42.6(pid=26532): Launched 08:37:39.793493 run osmo-stp_10.42.42.5(pid=26529): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26529)] 08:37:39.927533 run osmo-stp_10.42.42.5(pid=26529): stdout: | (launched: 2022-12-13_08:37:38.546054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:40.061710 run osmo-stp_10.42.42.5(pid=26529): stderr: | 20221213083738719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083738719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083738719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083738720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083738720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083738720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083738720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:40.192841 run osmo-stp_10.42.42.5(pid=26529): stdout: | (launched: 2022-12-13_08:37:38.546054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:40.319356 run osmo-stp_10.42.42.5(pid=26529): stderr: | 20221213083738719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083738719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083738719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083738720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083738720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083738720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083738720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:40.469569 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26529): Process ended prematurely: osmo-stp_10.42.42.5(pid=26529) [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26529)] [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:37:40.478930 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:37:40.505417 run osmo-hlr_10.42.42.2(pid=26526): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26526)] 08:37:40.554724 run osmo-hlr_10.42.42.2(pid=26526): stdout: | (launched: 2022-12-13_08:37:37.562778) 08:37:40.604817 run osmo-hlr_10.42.42.2(pid=26526): stderr: | 20221213083737742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083737742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083737742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083737743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083737743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083737743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083737758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083737769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083737769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083737769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:40.675158 run osmo-msc_10.42.42.6(pid=26532): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26532)] 08:37:40.723375 run osmo-msc_10.42.42.6(pid=26532): stdout: | (launched: 2022-12-13_08:37:39.557347) 08:37:40.773763 run osmo-msc_10.42.42.6(pid=26532): stderr: | 20221213083739833 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083739833 DLGLOBAL DEBUG validating counter group 0x7fd962c5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083739833 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083739833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083739833 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083739833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083739835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083739835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083739836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083739836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:40.824232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26525): Terminating (SIGTERM) 08:37:40.864744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26528): Terminating (SIGTERM) 08:37:40.905155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26531): Terminating (SIGTERM) 08:37:40.945836 --- ParallelTerminationStrategy: PID 26525 died... 08:37:40.965656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26525): Terminated: ok {rc=0} 08:37:41.010719 --- ParallelTerminationStrategy: PID 26528 died... 08:37:41.030019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26528): Terminated: ok {rc=0} 08:37:41.074990 --- ParallelTerminationStrategy: PID 26531 died... 08:37:41.094320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26531): Terminated: ok {rc=0} 08:37:41.179100 bus /sierra_3: Setting Powered False 08:37:42.279400 bus /sierra_3: Setting Powered False 08:37:43.396647 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:37:44.548096 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:44.560815 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:37:44.620519 tst mo_mt_call_osmux.py: using LAC 32757 08:37:44.752468 tst mo_mt_call_osmux.py: using RAC 117 08:37:44.885795 tst mo_mt_call_osmux.py: using CellId 32757 08:37:45.011759 tst mo_mt_call_osmux.py: using BVCI 32758 08:37:45.127946 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:45.139526 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:45.150855 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:45.162060 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:45.173646 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:45.185184 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:37:45.308788 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:37:45.430748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:45.919819 run create_hlr_db(pid=26534): Launched 08:37:46.090736 bus /sierra_2: Setting Powered False 08:37:47.157847 run create_hlr_db(pid=26534): Terminated: ok {rc=0} 08:37:47.611159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26536): Launched 08:37:47.928653 run osmo-hlr_10.42.42.2(pid=26537): Launched 08:37:48.050149 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:48.604652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26539): Launched 08:37:48.921504 run osmo-stp_10.42.42.5(pid=26540): Launched 08:37:49.041156 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:49.622965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26542): Launched 08:37:49.940433 run osmo-msc_10.42.42.6(pid=26543): Launched 08:37:50.117312 run osmo-stp_10.42.42.5(pid=26540): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26540)] 08:37:50.251013 run osmo-stp_10.42.42.5(pid=26540): stdout: | (launched: 2022-12-13_08:37:48.862238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:50.383743 run osmo-stp_10.42.42.5(pid=26540): stderr: | 20221213083749038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083749038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083749039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083749039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083749039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083749039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083749040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:50.515697 run osmo-stp_10.42.42.5(pid=26540): stdout: | (launched: 2022-12-13_08:37:48.862238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:50.641234 run osmo-stp_10.42.42.5(pid=26540): stderr: | 20221213083749038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083749038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083749039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083749039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083749039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083749039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083749040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:50.791208 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26540): Process ended prematurely: osmo-stp_10.42.42.5(pid=26540) [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26540)] [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:37:50.800466 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:37:50.827021 run osmo-hlr_10.42.42.2(pid=26537): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26537)] 08:37:50.875714 run osmo-hlr_10.42.42.2(pid=26537): stdout: | (launched: 2022-12-13_08:37:47.869858) 08:37:50.925968 run osmo-hlr_10.42.42.2(pid=26537): stderr: | 20221213083748051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083748051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083748051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083748051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083748051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083748051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083748064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083748073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083748074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083748074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:50.995761 run osmo-msc_10.42.42.6(pid=26543): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26543)] 08:37:51.043192 run osmo-msc_10.42.42.6(pid=26543): stdout: | (launched: 2022-12-13_08:37:49.881668) 08:37:51.092887 run osmo-msc_10.42.42.6(pid=26543): stderr: | 20221213083750157 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083750157 DLGLOBAL DEBUG validating counter group 0x7f84b1696c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083750157 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083750157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083750158 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083750158 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083750159 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083750160 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083750160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083750160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:51.143077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26536): Terminating (SIGTERM) 08:37:51.183271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26539): Terminating (SIGTERM) 08:37:51.223685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26542): Terminating (SIGTERM) 08:37:51.264129 --- ParallelTerminationStrategy: PID 26536 died... 08:37:51.284097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26536): Terminated: ok {rc=0} 08:37:51.329120 --- ParallelTerminationStrategy: PID 26539 died... 08:37:51.348438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26539): Terminated: ok {rc=0} 08:37:51.392889 --- ParallelTerminationStrategy: PID 26542 died... 08:37:51.412724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26542): Terminated: ok {rc=0} 08:37:51.499419 bus /sierra_3: Setting Powered False 08:37:52.599066 bus /sierra_3: Setting Powered False 08:37:53.715229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:37:54.959213 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:54.965850 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:37:54.987636 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:37:55.015541 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:37:55.068660 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:37:55.090399 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:37:55.118186 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:37:55.665115 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:37:55.719536 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:37:55.730851 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:37:55.789453 tst mo_mt_call.py: using LAC 32758 08:37:55.921636 tst mo_mt_call.py: using RAC 118 08:37:56.049435 tst mo_mt_call.py: using CellId 32758 08:37:56.173997 tst mo_mt_call.py: using BVCI 32759 08:37:56.290379 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:37:56.302010 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:37:56.312911 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:37:56.323736 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:37:56.335319 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:37:56.346779 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:37:56.469734 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:37:56.591470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:57.081160 run create_hlr_db(pid=26548): Launched 08:37:57.200519 bus /sierra_2: Setting Powered False 08:37:58.261969 run create_hlr_db(pid=26548): Terminated: ok {rc=0} 08:37:58.701565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26550): Launched 08:37:59.017193 run osmo-hlr_10.42.42.2(pid=26551): Launched 08:37:59.137507 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:59.682852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26553): Launched 08:38:00.001069 run osmo-stp_10.42.42.5(pid=26554): Launched 08:38:00.122302 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:00.694571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26556): Launched 08:38:01.037600 run osmo-msc_10.42.42.6(pid=26557): Launched 08:38:01.352244 run osmo-stp_10.42.42.5(pid=26554): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26554)] 08:38:01.639700 run osmo-stp_10.42.42.5(pid=26554): stdout: | (launched: 2022-12-13_08:37:59.941820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:01.832375 run osmo-stp_10.42.42.5(pid=26554): stderr: | 20221213083800116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083800116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083800117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083800117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083800118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083800118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083800118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:01.975064 run osmo-stp_10.42.42.5(pid=26554): stdout: | (launched: 2022-12-13_08:37:59.941820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:02.112182 run osmo-stp_10.42.42.5(pid=26554): stderr: | 20221213083800116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083800116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083800117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083800117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083800118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083800118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083800118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:02.276668 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26554): Process ended prematurely: osmo-stp_10.42.42.5(pid=26554) [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26554)] [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:38:02.286865 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:38:02.314974 run osmo-hlr_10.42.42.2(pid=26551): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26551)] 08:38:02.367827 run osmo-hlr_10.42.42.2(pid=26551): stdout: | (launched: 2022-12-13_08:37:58.958225) 08:38:02.423021 run osmo-hlr_10.42.42.2(pid=26551): stderr: | 20221213083759139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083759139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083759139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083759139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083759139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083759139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083759151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083759161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083759162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083759162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:02.496201 run osmo-msc_10.42.42.6(pid=26557): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26557)] 08:38:02.545070 run osmo-msc_10.42.42.6(pid=26557): stdout: | (launched: 2022-12-13_08:38:00.976727) 08:38:02.596268 run osmo-msc_10.42.42.6(pid=26557): stderr: | 20221213083801423 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083801425 DLGLOBAL DEBUG validating counter group 0x7f19ee4dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083801425 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083801425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083801426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083801426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083801428 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083801429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083801430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083801430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:02.648181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26550): Terminating (SIGTERM) 08:38:02.689794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26553): Terminating (SIGTERM) 08:38:02.731419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26556): Terminating (SIGTERM) 08:38:02.773215 --- ParallelTerminationStrategy: PID 26550 died... 08:38:02.793725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26550): Terminated: ok {rc=0} 08:38:02.839509 --- ParallelTerminationStrategy: PID 26553 died... 08:38:02.859416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26553): Terminated: ok {rc=0} 08:38:02.905066 --- ParallelTerminationStrategy: PID 26556 died... 08:38:02.925012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26556): Terminated: ok {rc=0} 08:38:03.013901 bus /sierra_3: Setting Powered False 08:38:04.114067 bus /sierra_3: Setting Powered False 08:38:05.229086 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:38:06.382902 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:06.395031 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:38:06.454578 tst mo_mt_call_osmux.py: using LAC 32759 08:38:06.585400 tst mo_mt_call_osmux.py: using RAC 119 08:38:06.717744 tst mo_mt_call_osmux.py: using CellId 32759 08:38:06.849906 tst mo_mt_call_osmux.py: using BVCI 32760 08:38:06.971354 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:06.983106 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:06.994639 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:07.006140 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:07.017835 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:07.029521 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:38:07.150939 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:38:07.268819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:07.756047 run create_hlr_db(pid=26559): Launched 08:38:07.878647 bus /sierra_2: Setting Powered False 08:38:08.941748 run create_hlr_db(pid=26559): Terminated: ok {rc=0} 08:38:09.379415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Launched 08:38:09.696022 run osmo-hlr_10.42.42.2(pid=26562): Launched 08:38:09.816698 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:10.371430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Launched 08:38:10.688673 run osmo-stp_10.42.42.5(pid=26565): Launched 08:38:10.811997 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:11.379984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26567): Launched 08:38:11.696221 run osmo-msc_10.42.42.6(pid=26568): Launched 08:38:11.874901 run osmo-stp_10.42.42.5(pid=26565): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] 08:38:12.008770 run osmo-stp_10.42.42.5(pid=26565): stdout: | (launched: 2022-12-13_08:38:10.629430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:12.141910 run osmo-stp_10.42.42.5(pid=26565): stderr: | 20221213083810802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083810802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083810802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083810804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083810804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083810804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083810804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:12.272351 run osmo-stp_10.42.42.5(pid=26565): stdout: | (launched: 2022-12-13_08:38:10.629430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:12.397364 run osmo-stp_10.42.42.5(pid=26565): stderr: | 20221213083810802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083810802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083810802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083810804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083810804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083810804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083810804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:12.546824 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26565): Process ended prematurely: osmo-stp_10.42.42.5(pid=26565) [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:38:12.555921 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:38:12.582572 run osmo-hlr_10.42.42.2(pid=26562): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26562)] 08:38:12.631673 run osmo-hlr_10.42.42.2(pid=26562): stdout: | (launched: 2022-12-13_08:38:09.637516) 08:38:12.682126 run osmo-hlr_10.42.42.2(pid=26562): stderr: | 20221213083809817 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083809817 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083809817 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083809817 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083809817 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083809818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083809830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083809841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083809841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083809841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:12.752562 run osmo-msc_10.42.42.6(pid=26568): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26568)] 08:38:12.800719 run osmo-msc_10.42.42.6(pid=26568): stdout: | (launched: 2022-12-13_08:38:11.637250) 08:38:12.850319 run osmo-msc_10.42.42.6(pid=26568): stderr: | 20221213083811910 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083811911 DLGLOBAL DEBUG validating counter group 0x7fc82a70cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083811911 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083811911 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083811911 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083811911 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083811913 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083811913 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083811914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083811914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:12.900425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Terminating (SIGTERM) 08:38:12.940669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Terminating (SIGTERM) 08:38:12.980761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26567): Terminating (SIGTERM) 08:38:13.020891 --- ParallelTerminationStrategy: PID 26561 died... 08:38:13.041076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Terminated: ok {rc=0} 08:38:13.085427 --- ParallelTerminationStrategy: PID 26564 died... 08:38:13.104402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Terminated: ok {rc=0} 08:38:13.149055 --- ParallelTerminationStrategy: PID 26567 died... 08:38:13.168343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26567): Terminated: ok {rc=0} 08:38:13.256095 bus /sierra_3: Setting Powered False 08:38:14.355223 bus /sierra_3: Setting Powered False 08:38:15.469887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:sysmo --------------------------------------------------------------------- 08:38:16.713556 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:16.720856 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 08:38:16.749107 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 08:38:16.786776 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 08:38:16.894107 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 08:38:16.918753 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 08:38:16.954128 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 08:38:17.530574 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 08:38:17.536173 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:17.547496 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:38:17.583640 tst emergency_mo_mt_call.py: using LAC 32760 08:38:17.713556 tst emergency_mo_mt_call.py: using RAC 120 08:38:17.844174 tst emergency_mo_mt_call.py: using CellId 32760 08:38:17.974476 tst emergency_mo_mt_call.py: using BVCI 32761 08:38:18.094253 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:18.105452 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:18.116359 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:18.127357 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:18.139192 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:18.150713 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:38:18.270123 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:38:18.390245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:18.873494 run create_hlr_db(pid=26573): Launched 08:38:18.992693 bus /sierra_2: Setting Powered False 08:38:20.054042 run create_hlr_db(pid=26573): Terminated: ok {rc=0} 08:38:20.507606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26575): Launched 08:38:20.841779 run osmo-hlr_10.42.42.2(pid=26576): Launched 08:38:20.967177 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:21.535714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26578): Launched 08:38:21.867261 run osmo-stp_10.42.42.5(pid=26579): Launched 08:38:22.004179 tst emergency_mo_mt_call.py: using MSISDN 8070 08:38:22.173469 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:22.768085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26581): Launched 08:38:23.099170 run osmo-msc_10.42.42.6(pid=26582): Launched 08:38:23.284314 run osmo-stp_10.42.42.5(pid=26579): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26579)] 08:38:23.423264 run osmo-stp_10.42.42.5(pid=26579): stdout: | (launched: 2022-12-13_08:38:21.805592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:23.562608 run osmo-stp_10.42.42.5(pid=26579): stderr: | 20221213083822000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083822000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083822000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083822000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083822003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083822003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083822003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:23.701057 run osmo-stp_10.42.42.5(pid=26579): stdout: | (launched: 2022-12-13_08:38:21.805592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:23.832640 run osmo-stp_10.42.42.5(pid=26579): stderr: | 20221213083822000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083822000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083822000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083822000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083822003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083822003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083822003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:23.989851 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26579): Process ended prematurely: osmo-stp_10.42.42.5(pid=26579) [trial-2387↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26579)] [trial-2387↪emergency:sysmo↪emergency_mo_mt_call.py:19] 08:38:23.998949 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 08:38:24.026607 run osmo-hlr_10.42.42.2(pid=26576): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26576)] 08:38:24.079362 run osmo-hlr_10.42.42.2(pid=26576): stdout: | (launched: 2022-12-13_08:38:20.779927) 08:38:24.131994 run osmo-hlr_10.42.42.2(pid=26576): stderr: | 20221213083820981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083820981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083820981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083820981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083820981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083820981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083821002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083821012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083821013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083821013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:24.205625 run osmo-msc_10.42.42.6(pid=26582): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26582)] 08:38:24.256278 run osmo-msc_10.42.42.6(pid=26582): stdout: | (launched: 2022-12-13_08:38:23.037703) 08:38:24.308852 run osmo-msc_10.42.42.6(pid=26582): stderr: | 20221213083823364 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083823364 DLGLOBAL DEBUG validating counter group 0x7f0e56cd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083823364 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083823364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083823364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083823365 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083823366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083823367 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083823367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083823367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:24.361592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26575): Terminating (SIGTERM) 08:38:24.404500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26578): Terminating (SIGTERM) 08:38:24.447777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26581): Terminating (SIGTERM) 08:38:24.490897 --- ParallelTerminationStrategy: PID 26575 died... 08:38:24.511621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26575): Terminated: ok {rc=0} 08:38:24.559001 --- ParallelTerminationStrategy: PID 26578 died... 08:38:24.579169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26578): Terminated: ok {rc=0} 08:38:24.626116 --- ParallelTerminationStrategy: PID 26581 died... 08:38:24.646210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26581): Terminated: ok {rc=0} 08:38:24.734541 bus /sierra_3: Setting Powered False 08:38:25.834098 bus /sierra_3: Setting Powered False 08:38:26.951507 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 08:38:28.039726 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:28.051157 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:38:28.092701 tst emergency_preemptive_call.py: using LAC 32761 08:38:28.223950 tst emergency_preemptive_call.py: using RAC 121 08:38:28.352177 tst emergency_preemptive_call.py: using CellId 32761 08:38:28.479834 tst emergency_preemptive_call.py: using BVCI 32762 08:38:28.601393 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:28.612736 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:28.624043 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:28.635243 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:28.646628 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:38:28.657781 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:38:28.776770 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:38:28.897981 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:38:29.019194 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:38:29.136608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:29.618068 run create_hlr_db(pid=26584): Launched 08:38:29.756883 bus /sierra_2: Setting Powered False 08:38:30.822137 run create_hlr_db(pid=26584): Terminated: ok {rc=0} 08:38:31.310699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26586): Launched 08:38:31.643867 run osmo-hlr_10.42.42.2(pid=26587): Launched 08:38:31.839635 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:32.533281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26589): Launched 08:38:32.845179 run osmo-stp_10.42.42.5(pid=26590): Launched 08:38:32.972498 tst emergency_preemptive_call.py: using MSISDN 8071 08:38:33.130873 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:33.686679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26592): Launched 08:38:33.998959 run osmo-msc_10.42.42.6(pid=26593): Launched 08:38:34.180806 run osmo-stp_10.42.42.5(pid=26590): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26590)] 08:38:34.311855 run osmo-stp_10.42.42.5(pid=26590): stdout: | (launched: 2022-12-13_08:38:32.786672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:34.442536 run osmo-stp_10.42.42.5(pid=26590): stderr: | 20221213083832961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083832961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083832962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083832962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083832962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083832963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083832963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:34.571210 run osmo-stp_10.42.42.5(pid=26590): stdout: | (launched: 2022-12-13_08:38:32.786672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:34.694076 run osmo-stp_10.42.42.5(pid=26590): stderr: | 20221213083832961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083832961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083832962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083832962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083832962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083832963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083832963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:34.841182 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26590): Process ended prematurely: osmo-stp_10.42.42.5(pid=26590) [trial-2387↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26590)] [trial-2387↪emergency:sysmo↪emergency_preemptive_call.py:32] 08:38:34.849505 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 08:38:34.875568 run osmo-hlr_10.42.42.2(pid=26587): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26587)] 08:38:34.924566 run osmo-hlr_10.42.42.2(pid=26587): stdout: | (launched: 2022-12-13_08:38:31.583358) 08:38:34.974300 run osmo-hlr_10.42.42.2(pid=26587): stderr: | 20221213083831955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083831955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083831955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083831955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083831955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083831955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083831983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083831999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083832000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083832000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:35.043900 run osmo-msc_10.42.42.6(pid=26593): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26593)] 08:38:35.091334 run osmo-msc_10.42.42.6(pid=26593): stdout: | (launched: 2022-12-13_08:38:33.940568) 08:38:35.140595 run osmo-msc_10.42.42.6(pid=26593): stderr: | 20221213083834217 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213083834217 DLGLOBAL DEBUG validating counter group 0x7f0796b31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213083834218 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213083834218 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213083834218 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213083834218 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213083834220 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213083834220 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213083834220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213083834220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:35.190178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26586): Terminating (SIGTERM) 08:38:35.229797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26589): Terminating (SIGTERM) 08:38:35.269481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26592): Terminating (SIGTERM) 08:38:35.309669 --- ParallelTerminationStrategy: PID 26586 died... 08:38:35.329179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26586): Terminated: ok {rc=0} 08:38:35.373499 --- ParallelTerminationStrategy: PID 26589 died... 08:38:35.392496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26589): Terminated: ok {rc=0} 08:38:35.437074 --- ParallelTerminationStrategy: PID 26592 died... 08:38:35.456095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26592): Terminated: ok {rc=0} 08:38:35.543555 bus /sierra_9: Setting Powered False 08:38:36.642680 bus /sierra_9: Setting Powered False 08:38:37.757958 bus /sierra_8: Setting Powered False 08:38:38.856746 bus /sierra_8: Setting Powered False 08:38:39.969489 bus /sierra_3: Setting Powered False 08:38:41.068847 bus /sierra_3: Setting Powered False 08:38:42.185760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:sysmo --------------------------------------------------------------------- 08:38:43.454754 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:43.460403 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 08:38:43.482007 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 08:38:43.521937 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 08:38:43.610442 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 08:38:43.631900 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 08:38:43.671697 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 08:38:44.264877 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 08:38:44.321240 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.332296 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:38:44.367438 tst cs_paging_gprs_active.py: using LAC 32762 08:38:44.498002 tst cs_paging_gprs_active.py: using RAC 122 08:38:44.628888 tst cs_paging_gprs_active.py: using CellId 32762 08:38:44.761677 tst cs_paging_gprs_active.py: using BVCI 32763 08:38:44.884500 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.895598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.906584 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.917520 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.928331 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.939533 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.950532 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.961709 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:44.972637 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:38:45.096272 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:38:45.214758 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:38:45.427591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:38:45.745346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26598): Launched 08:38:46.057702 run iperf3-srv_10.42.42.10(pid=26599): Launched 08:38:46.185877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:38:46.408428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:38:46.766993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26609): Launched 08:38:47.136416 run iperf3-srv_10.42.42.10(pid=26633): Launched 08:38:47.289907 tst cs_paging_gprs_active.py:38: start network... 08:38:47.524136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:48.089600 run create_hlr_db(pid=26658): Launched 08:38:48.287996 bus /sierra_2: Setting Powered False 08:38:49.352765 run create_hlr_db(pid=26658): Terminated: ok {rc=0} 08:38:49.850577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26873): Launched 08:38:50.187846 run osmo-hlr_10.42.42.2(pid=26874): Launched 08:38:50.436015 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:51.177681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26877): Launched 08:38:51.529632 run osmo-stp_10.42.42.5(pid=26879): Launched 08:38:51.777469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:53.490436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26881): Launched 08:38:53.631383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:53.922205 run patchelf(pid=26882): Launched 08:38:54.140206 run osmo-stp_10.42.42.5(pid=26879): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26879)] 08:38:54.285203 run osmo-stp_10.42.42.5(pid=26879): stdout: | (launched: 2022-12-13_08:38:51.461089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:54.433120 run osmo-stp_10.42.42.5(pid=26879): stderr: | 20221213083851785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083851785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083851786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083851786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083851786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083851786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083851787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:54.579416 run osmo-stp_10.42.42.5(pid=26879): stdout: | (launched: 2022-12-13_08:38:51.461089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:54.722385 run osmo-stp_10.42.42.5(pid=26879): stderr: | 20221213083851785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083851785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083851786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083851786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083851786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083851786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083851787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:54.891047 run patchelf(pid=26882): Terminating (SIGINT) 08:38:55.085376 run patchelf(pid=26882): Terminated: ok {rc=0} 08:38:55.225398 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26879): Process ended prematurely: osmo-stp_10.42.42.5(pid=26879) [trial-2387↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26879)] [trial-2387↪gprs:sysmo↪cs_paging_gprs_active.py:38] 08:38:55.236665 tst cs_paging_gprs_active.py:38: Test FAILED (11.0 sec) 08:38:55.267175 run osmo-hlr_10.42.42.2(pid=26874): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26874)] 08:38:55.320786 run osmo-hlr_10.42.42.2(pid=26874): stdout: | (launched: 2022-12-13_08:38:50.127373) 08:38:55.375797 run osmo-hlr_10.42.42.2(pid=26874): stderr: | 20221213083850472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083850472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083850472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083850472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083850472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083850472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083850490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083850498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083850498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083850498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:55.431950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26598): Terminating (SIGTERM) 08:38:55.476502 run iperf3-srv_10.42.42.10(pid=26599): Terminating (SIGTERM) 08:38:55.528596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26609): Terminating (SIGTERM) 08:38:55.573967 run iperf3-srv_10.42.42.10(pid=26633): Terminating (SIGTERM) 08:38:55.620628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26873): Terminating (SIGTERM) 08:38:55.666852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26877): Terminating (SIGTERM) 08:38:55.713822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26881): Terminating (SIGTERM) 08:38:55.760157 --- ParallelTerminationStrategy: PID 26598 died... 08:38:55.781578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26598): Terminated: ok {rc=0} 08:38:55.832461 --- ParallelTerminationStrategy: PID 26599 died... 08:38:55.852775 run iperf3-srv_10.42.42.10(pid=26599): Terminated {rc=256} 08:38:55.900610 --- ParallelTerminationStrategy: PID 26609 died... 08:38:55.922006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26609): Terminated: ok {rc=0} 08:38:55.970217 --- ParallelTerminationStrategy: PID 26633 died... 08:38:55.991679 run iperf3-srv_10.42.42.10(pid=26633): Terminated {rc=256} 08:38:56.040674 --- ParallelTerminationStrategy: PID 26873 died... 08:38:56.062455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26873): Terminated: ok {rc=0} 08:38:56.111384 --- ParallelTerminationStrategy: PID 26877 died... 08:38:56.133227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26877): Terminated: ok {rc=0} 08:38:56.182414 --- ParallelTerminationStrategy: PID 26881 died... 08:38:56.203971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26881): Terminated: ok {rc=0} 08:38:56.298815 bus /gobi_0: Setting Powered False 08:38:57.404015 bus /gobi_0: Setting Powered False 08:38:58.526997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo iperf3.py ---------------------------------------------- 08:38:59.684495 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:38:59.697433 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:38:59.735229 tst iperf3.py: using LAC 32763 08:38:59.866484 tst iperf3.py: using RAC 123 08:38:59.997833 tst iperf3.py: using CellId 32763 08:39:00.132168 tst iperf3.py: using BVCI 32764 08:39:00.254933 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.266728 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.278486 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.290253 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.315109 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.328270 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.341439 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.353461 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:00.366697 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:39:00.494988 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:39:00.728572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:01.084922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26883): Launched 08:39:01.429920 run iperf3-srv_10.42.42.10(pid=26884): Launched 08:39:01.645415 tst iperf3.py:8: start network... 08:39:01.914181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:02.522965 run create_hlr_db(pid=26885): Launched 08:39:02.730108 bus /gobi_6: Setting Powered False 08:39:03.793566 run create_hlr_db(pid=26885): Terminated: ok {rc=0} 08:39:04.268535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26887): Launched 08:39:04.608376 run osmo-hlr_10.42.42.2(pid=26888): Launched 08:39:04.862709 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:05.611770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26890): Launched 08:39:05.952422 run osmo-stp_10.42.42.5(pid=26891): Launched 08:39:06.205617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:06.932425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26893): Launched 08:39:07.070596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:07.348455 run patchelf(pid=26894): Launched 08:39:07.544647 run osmo-stp_10.42.42.5(pid=26891): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26891)] 08:39:07.686248 run osmo-stp_10.42.42.5(pid=26891): stdout: | (launched: 2022-12-13_08:39:05.891762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:07.826505 run osmo-stp_10.42.42.5(pid=26891): stderr: | 20221213083906230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083906230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083906230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083906231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083906231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083906231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083906231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:07.967974 run osmo-stp_10.42.42.5(pid=26891): stdout: | (launched: 2022-12-13_08:39:05.891762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:08.103683 run osmo-stp_10.42.42.5(pid=26891): stderr: | 20221213083906230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083906230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083906230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083906231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083906231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083906231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083906231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:08.263906 run patchelf(pid=26894): Terminating (SIGINT) 08:39:08.449452 run patchelf(pid=26894): Terminated: ok {rc=0} 08:39:08.583048 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26891): Process ended prematurely: osmo-stp_10.42.42.5(pid=26891) [trial-2387↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26891)] [trial-2387↪gprs:sysmo↪iperf3.py:8] 08:39:08.594130 tst iperf3.py:8: Test FAILED (9.0 sec) 08:39:08.623372 run osmo-hlr_10.42.42.2(pid=26888): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26888)] 08:39:08.678480 run osmo-hlr_10.42.42.2(pid=26888): stdout: | (launched: 2022-12-13_08:39:04.547147) 08:39:08.731917 run osmo-hlr_10.42.42.2(pid=26888): stderr: | 20221213083904902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083904902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083904902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083904902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083904902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083904902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083904915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083904932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083904932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083904932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:08.785774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26883): Terminating (SIGTERM) 08:39:08.831094 run iperf3-srv_10.42.42.10(pid=26884): Terminating (SIGTERM) 08:39:08.878605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26887): Terminating (SIGTERM) 08:39:08.923051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26890): Terminating (SIGTERM) 08:39:08.968925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26893): Terminating (SIGTERM) 08:39:09.015150 --- ParallelTerminationStrategy: PID 26883 died... 08:39:09.038313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26883): Terminated: ok {rc=0} 08:39:09.087658 --- ParallelTerminationStrategy: PID 26884 died... 08:39:09.109412 run iperf3-srv_10.42.42.10(pid=26884): Terminated {rc=256} 08:39:09.158238 --- ParallelTerminationStrategy: PID 26887 died... 08:39:09.179882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26887): Terminated: ok {rc=0} 08:39:09.228372 --- ParallelTerminationStrategy: PID 26890 died... 08:39:09.249655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26890): Terminated: ok {rc=0} 08:39:09.297341 --- ParallelTerminationStrategy: PID 26893 died... 08:39:09.318590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26893): Terminated: ok {rc=0} 08:39:09.410044 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo iperf3m4.py ---------------------------------------------- 08:39:10.560775 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:10.572250 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:39:10.614363 tst iperf3m4.py: using LAC 32764 08:39:10.738637 tst iperf3m4.py: using RAC 124 08:39:10.862153 tst iperf3m4.py: using CellId 32764 08:39:10.985371 tst iperf3m4.py: using BVCI 32765 08:39:11.101673 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.112483 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.123295 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.134006 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.145779 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.157699 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.169618 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.181119 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:11.192807 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:39:11.316641 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:39:11.438918 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:39:11.561988 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:39:11.685209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:39:11.912543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:12.250934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26896): Launched 08:39:12.546182 run iperf3-srv_10.42.42.10(pid=26897): Launched 08:39:12.675122 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:39:12.902968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:13.243433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26898): Launched 08:39:13.536570 run iperf3-srv_10.42.42.10(pid=26899): Launched 08:39:13.663818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:39:13.890751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:14.228822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26900): Launched 08:39:14.521716 run iperf3-srv_10.42.42.10(pid=26901): Launched 08:39:14.649041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:39:14.875733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:15.214514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26902): Launched 08:39:15.526413 run iperf3-srv_10.42.42.10(pid=26903): Launched 08:39:15.646766 tst iperf3m4.py:8: start network... 08:39:15.858081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:16.429306 run create_hlr_db(pid=26904): Launched 08:39:16.588009 bus /gobi_6: Setting Powered False 08:39:17.650794 run create_hlr_db(pid=26904): Terminated: ok {rc=0} 08:39:18.089344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26906): Launched 08:39:18.404304 run osmo-hlr_10.42.42.2(pid=26907): Launched 08:39:18.526625 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:19.079040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26909): Launched 08:39:19.397076 run osmo-stp_10.42.42.5(pid=26910): Launched 08:39:19.517977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:20.060845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26912): Launched 08:39:20.180816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:20.448407 run patchelf(pid=26913): Launched 08:39:20.623637 run osmo-stp_10.42.42.5(pid=26910): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26910)] 08:39:20.756935 run osmo-stp_10.42.42.5(pid=26910): stdout: | (launched: 2022-12-13_08:39:19.337282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:20.891503 run osmo-stp_10.42.42.5(pid=26910): stderr: | 20221213083919513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083919513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083919513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083919514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083919514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083919514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083919514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:21.026125 run osmo-stp_10.42.42.5(pid=26910): stdout: | (launched: 2022-12-13_08:39:19.337282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:21.154739 run osmo-stp_10.42.42.5(pid=26910): stderr: | 20221213083919513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083919513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083919513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083919514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083919514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083919514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083919514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:21.307979 run patchelf(pid=26913): Terminating (SIGINT) 08:39:21.483728 run patchelf(pid=26913): Terminated: ok {rc=0} 08:39:21.610899 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26910): Process ended prematurely: osmo-stp_10.42.42.5(pid=26910) [trial-2387↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26910)] [trial-2387↪gprs:sysmo↪iperf3m4.py:8] 08:39:21.620363 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:39:21.648156 run osmo-hlr_10.42.42.2(pid=26907): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26907)] 08:39:21.697463 run osmo-hlr_10.42.42.2(pid=26907): stdout: | (launched: 2022-12-13_08:39:18.345101) 08:39:21.748259 run osmo-hlr_10.42.42.2(pid=26907): stderr: | 20221213083918525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083918525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083918525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083918525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083918526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083918526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083918537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083918545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083918545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083918545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:21.799602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26896): Terminating (SIGTERM) 08:39:21.840728 run iperf3-srv_10.42.42.10(pid=26897): Terminating (SIGTERM) 08:39:21.883196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26898): Terminating (SIGTERM) 08:39:21.924416 run iperf3-srv_10.42.42.10(pid=26899): Terminating (SIGTERM) 08:39:21.965192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26900): Terminating (SIGTERM) 08:39:22.006011 run iperf3-srv_10.42.42.10(pid=26901): Terminating (SIGTERM) 08:39:22.046720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26902): Terminating (SIGTERM) 08:39:22.087505 run iperf3-srv_10.42.42.10(pid=26903): Terminating (SIGTERM) 08:39:22.128227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26906): Terminating (SIGTERM) 08:39:22.169181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26909): Terminating (SIGTERM) 08:39:22.209954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26912): Terminating (SIGTERM) 08:39:22.250900 --- ParallelTerminationStrategy: PID 26896 died... 08:39:22.270925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26896): Terminated: ok {rc=0} 08:39:22.316055 --- ParallelTerminationStrategy: PID 26897 died... 08:39:22.335434 run iperf3-srv_10.42.42.10(pid=26897): Terminated {rc=256} 08:39:22.380075 --- ParallelTerminationStrategy: PID 26898 died... 08:39:22.399429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26898): Terminated: ok {rc=0} 08:39:22.444197 --- ParallelTerminationStrategy: PID 26899 died... 08:39:22.463503 run iperf3-srv_10.42.42.10(pid=26899): Terminated {rc=256} 08:39:22.508271 --- ParallelTerminationStrategy: PID 26900 died... 08:39:22.527461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26900): Terminated: ok {rc=0} 08:39:22.572318 --- ParallelTerminationStrategy: PID 26901 died... 08:39:22.591673 run iperf3-srv_10.42.42.10(pid=26901): Terminated {rc=256} 08:39:22.636269 --- ParallelTerminationStrategy: PID 26902 died... 08:39:22.655440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26902): Terminated: ok {rc=0} 08:39:22.700201 --- ParallelTerminationStrategy: PID 26903 died... 08:39:22.719513 run iperf3-srv_10.42.42.10(pid=26903): Terminated {rc=256} 08:39:22.764201 --- ParallelTerminationStrategy: PID 26906 died... 08:39:22.783626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26906): Terminated: ok {rc=0} 08:39:22.828276 --- ParallelTerminationStrategy: PID 26909 died... 08:39:22.847971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26909): Terminated: ok {rc=0} 08:39:22.892341 --- ParallelTerminationStrategy: PID 26912 died... 08:39:22.911545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26912): Terminated: ok {rc=0} 08:39:22.995860 bus /gobi_4: Setting Powered False 08:39:24.095448 bus /gobi_4: Setting Powered False 08:39:25.212786 bus /gobi_1: Setting Powered False 08:39:26.311442 bus /gobi_1: Setting Powered False 08:39:27.427827 bus /gobi_0: Setting Powered False 08:39:28.526428 bus /gobi_0: Setting Powered False 08:39:29.644189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo ping.py ---------------------------------------------- 08:39:30.746720 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:30.758451 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:39:30.794874 tst ping.py: using LAC 32765 08:39:30.917713 tst ping.py: using RAC 125 08:39:31.067250 tst ping.py: using CellId 32765 08:39:31.208787 tst ping.py: using BVCI 32766 08:39:31.358204 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:31.371444 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:31.382835 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:31.396247 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:31.412555 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:31.430225 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:31.446037 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:31.462222 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:39:31.595903 tst ping.py:19: start network... 08:39:31.887171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:32.448397 run create_hlr_db(pid=26914): Launched 08:39:32.582573 bus /gobi_6: Setting Powered False 08:39:33.647599 run create_hlr_db(pid=26914): Terminated: ok {rc=0} 08:39:34.107439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26916): Launched 08:39:34.440138 run osmo-hlr_10.42.42.2(pid=26917): Launched 08:39:34.566535 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:35.134845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26919): Launched 08:39:35.466441 run osmo-stp_10.42.42.5(pid=26920): Launched 08:39:35.591950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:36.163176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26922): Launched 08:39:36.289217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:36.569686 run patchelf(pid=26923): Launched 08:39:36.752259 run osmo-stp_10.42.42.5(pid=26920): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26920)] 08:39:36.891446 run osmo-stp_10.42.42.5(pid=26920): stdout: | (launched: 2022-12-13_08:39:35.404357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:37.032126 run osmo-stp_10.42.42.5(pid=26920): stderr: | 20221213083935601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083935601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083935602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083935602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083935603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083935603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083935603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:37.172807 run osmo-stp_10.42.42.5(pid=26920): stdout: | (launched: 2022-12-13_08:39:35.404357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:37.307617 run osmo-stp_10.42.42.5(pid=26920): stderr: | 20221213083935601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083935601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083935602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083935602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083935603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083935603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083935603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:37.468214 run patchelf(pid=26923): Terminating (SIGINT) 08:39:37.651557 run patchelf(pid=26923): Terminated: ok {rc=0} 08:39:37.783796 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26920): Process ended prematurely: osmo-stp_10.42.42.5(pid=26920) [trial-2387↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26920)] [trial-2387↪gprs:sysmo↪ping.py:22] 08:39:37.793294 tst ping.py:22: Test FAILED (7.0 sec) 08:39:37.821556 run osmo-hlr_10.42.42.2(pid=26917): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26917)] 08:39:37.872128 run osmo-hlr_10.42.42.2(pid=26917): stdout: | (launched: 2022-12-13_08:39:34.378205) 08:39:37.924531 run osmo-hlr_10.42.42.2(pid=26917): stderr: | 20221213083934579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083934579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083934579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083934579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083934579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083934579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083934591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083934600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083934600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083934600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:37.977345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26916): Terminating (SIGTERM) 08:39:38.019865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26919): Terminating (SIGTERM) 08:39:38.063130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26922): Terminating (SIGTERM) 08:39:38.106594 --- ParallelTerminationStrategy: PID 26916 died... 08:39:38.127115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26916): Terminated: ok {rc=0} 08:39:38.173976 --- ParallelTerminationStrategy: PID 26919 died... 08:39:38.193855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26919): Terminated: ok {rc=0} 08:39:38.240467 --- ParallelTerminationStrategy: PID 26922 died... 08:39:38.260310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26922): Terminated: ok {rc=0} 08:39:38.349025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 08:39:39.436599 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:39.448441 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:39:39.485500 tst ping_idle_ping.py: using LAC 32766 08:39:39.617039 tst ping_idle_ping.py: using RAC 126 08:39:39.746198 tst ping_idle_ping.py: using CellId 32766 08:39:39.870909 tst ping_idle_ping.py: using BVCI 32767 08:39:39.985645 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:39.996535 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:40.007267 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:40.017926 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:40.028527 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:40.039880 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:40.050884 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:39:40.061969 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:39:40.186947 tst ping_idle_ping.py:24: start network... 08:39:40.396105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:40.878575 run create_hlr_db(pid=26924): Launched 08:39:40.997836 bus /gobi_6: Setting Powered False 08:39:42.058506 run create_hlr_db(pid=26924): Terminated: ok {rc=0} 08:39:42.511849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26926): Launched 08:39:42.843811 run osmo-hlr_10.42.42.2(pid=26927): Launched 08:39:42.971697 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:43.542619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26929): Launched 08:39:43.875647 run osmo-stp_10.42.42.5(pid=26930): Launched 08:39:44.003124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:44.575676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26932): Launched 08:39:44.702332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:44.983699 run patchelf(pid=26933): Launched 08:39:45.168415 run osmo-stp_10.42.42.5(pid=26930): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26930)] 08:39:45.307774 run osmo-stp_10.42.42.5(pid=26930): stdout: | (launched: 2022-12-13_08:39:43.813720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:45.449854 run osmo-stp_10.42.42.5(pid=26930): stderr: | 20221213083944009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083944009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083944009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083944010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083944010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083944010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083944010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:45.590758 run osmo-stp_10.42.42.5(pid=26930): stdout: | (launched: 2022-12-13_08:39:43.813720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:45.726201 run osmo-stp_10.42.42.5(pid=26930): stderr: | 20221213083944009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083944009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083944009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083944010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083944010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083944010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083944010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:45.886550 run patchelf(pid=26933): Terminating (SIGINT) 08:39:46.075480 run patchelf(pid=26933): Terminated: ok {rc=0} 08:39:46.214688 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26930): Process ended prematurely: osmo-stp_10.42.42.5(pid=26930) [trial-2387↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26930)] [trial-2387↪gprs:sysmo↪ping_idle_ping.py:27] 08:39:46.228567 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:39:46.266741 run osmo-hlr_10.42.42.2(pid=26927): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26927)] 08:39:46.333225 run osmo-hlr_10.42.42.2(pid=26927): stdout: | (launched: 2022-12-13_08:39:42.782088) 08:39:46.400877 run osmo-hlr_10.42.42.2(pid=26927): stderr: | 20221213083942981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083942981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083942981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083942981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083942981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083942981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083942993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083943002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083943002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083943002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:46.470520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26926): Terminating (SIGTERM) 08:39:46.527118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26929): Terminating (SIGTERM) 08:39:46.572437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26932): Terminating (SIGTERM) 08:39:46.618474 --- ParallelTerminationStrategy: PID 26926 died... 08:39:46.641692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26926): Terminated: ok {rc=0} 08:39:46.691188 --- ParallelTerminationStrategy: PID 26929 died... 08:39:46.714041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26929): Terminated: ok {rc=0} 08:39:46.762330 --- ParallelTerminationStrategy: PID 26932 died... 08:39:46.783395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26932): Terminated: ok {rc=0} 08:39:46.875017 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 08:39:48.167684 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:39:48.173699 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:39:48.195108 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:39:48.234608 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:39:48.323293 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:39:48.344834 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:39:48.384871 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:39:48.979112 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:39:49.033318 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.044577 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:39:49.082606 tst cs_paging_gprs_active.py: using LAC 32767 08:39:49.214376 tst cs_paging_gprs_active.py: using RAC 127 08:39:49.347814 tst cs_paging_gprs_active.py: using CellId 32767 08:39:49.479844 tst cs_paging_gprs_active.py: using BVCI 32768 08:39:49.604395 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.615798 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.627005 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.638254 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.649540 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.660664 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.672095 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.683110 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:39:49.694824 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:39:49.815529 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:39:49.934450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:39:50.148195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:50.468193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26939): Launched 08:39:50.747766 run iperf3-srv_10.42.42.10(pid=26940): Launched 08:39:50.867675 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:39:51.080054 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:51.398900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26941): Launched 08:39:51.677593 run iperf3-srv_10.42.42.10(pid=26942): Launched 08:39:51.796317 tst cs_paging_gprs_active.py:38: start network... 08:39:52.009071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:52.500352 run create_hlr_db(pid=26943): Launched 08:39:52.623292 bus /gobi_6: Setting Powered False 08:39:53.685777 run create_hlr_db(pid=26943): Terminated: ok {rc=0} 08:39:54.125827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26945): Launched 08:39:54.444646 run osmo-hlr_10.42.42.2(pid=26946): Launched 08:39:54.568344 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:55.129971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26948): Launched 08:39:55.448776 run osmo-stp_10.42.42.5(pid=26949): Launched 08:39:55.570603 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:56.116292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26951): Launched 08:39:56.238641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:56.507810 run patchelf(pid=26952): Launched 08:39:56.684172 run osmo-stp_10.42.42.5(pid=26949): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26949)] 08:39:56.817527 run osmo-stp_10.42.42.5(pid=26949): stdout: | (launched: 2022-12-13_08:39:55.389419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:56.952132 run osmo-stp_10.42.42.5(pid=26949): stderr: | 20221213083955566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083955566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083955566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083955567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083955567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083955567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083955567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:57.087045 run osmo-stp_10.42.42.5(pid=26949): stdout: | (launched: 2022-12-13_08:39:55.389419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:57.216383 run osmo-stp_10.42.42.5(pid=26949): stderr: | 20221213083955566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213083955566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213083955566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213083955567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213083955567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213083955567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213083955567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:57.369845 run patchelf(pid=26952): Terminating (SIGINT) 08:39:57.547605 run patchelf(pid=26952): Terminated: ok {rc=0} 08:39:57.674788 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26949): Process ended prematurely: osmo-stp_10.42.42.5(pid=26949) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26949)] [trial-2387↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:39:57.684322 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:39:57.711552 run osmo-hlr_10.42.42.2(pid=26946): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26946)] 08:39:57.760273 run osmo-hlr_10.42.42.2(pid=26946): stdout: | (launched: 2022-12-13_08:39:54.385584) 08:39:57.810488 run osmo-hlr_10.42.42.2(pid=26946): stderr: | 20221213083954568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213083954568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213083954568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213083954568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213083954568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213083954568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213083954579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213083954588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213083954588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213083954588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:57.861078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26939): Terminating (SIGTERM) 08:39:57.901378 run iperf3-srv_10.42.42.10(pid=26940): Terminating (SIGTERM) 08:39:57.941546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26941): Terminating (SIGTERM) 08:39:57.981961 run iperf3-srv_10.42.42.10(pid=26942): Terminating (SIGTERM) 08:39:58.022133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26945): Terminating (SIGTERM) 08:39:58.062562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26948): Terminating (SIGTERM) 08:39:58.102885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26951): Terminating (SIGTERM) 08:39:58.143589 --- ParallelTerminationStrategy: PID 26939 died... 08:39:58.163398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26939): Terminated: ok {rc=0} 08:39:58.208085 --- ParallelTerminationStrategy: PID 26940 died... 08:39:58.227000 run iperf3-srv_10.42.42.10(pid=26940): Terminated {rc=256} 08:39:58.271578 --- ParallelTerminationStrategy: PID 26941 died... 08:39:58.290678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26941): Terminated: ok {rc=0} 08:39:58.334884 --- ParallelTerminationStrategy: PID 26942 died... 08:39:58.353742 run iperf3-srv_10.42.42.10(pid=26942): Terminated {rc=256} 08:39:58.398021 --- ParallelTerminationStrategy: PID 26945 died... 08:39:58.416937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26945): Terminated: ok {rc=0} 08:39:58.461387 --- ParallelTerminationStrategy: PID 26948 died... 08:39:58.480325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26948): Terminated: ok {rc=0} 08:39:58.525673 --- ParallelTerminationStrategy: PID 26951 died... 08:39:58.544785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26951): Terminated: ok {rc=0} 08:39:58.630016 bus /gobi_0: Setting Powered False 08:39:59.723995 bus /gobi_0: Setting Powered False 08:40:00.838263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:40:01.996246 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.008914 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:02.049469 tst iperf3.py: using LAC 32768 08:40:02.213858 tst iperf3.py: using RAC 128 08:40:02.341589 tst iperf3.py: using CellId 32768 08:40:02.472399 tst iperf3.py: using BVCI 32769 08:40:02.588700 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.599890 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.610878 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.621777 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.632932 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.643847 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.654997 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.666024 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:02.677072 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:02.798759 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:40:03.009833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:03.327004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26956): Launched 08:40:03.604083 run iperf3-srv_10.42.42.10(pid=26957): Launched 08:40:03.724144 tst iperf3.py:8: start network... 08:40:03.935577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:04.424779 run create_hlr_db(pid=26958): Launched 08:40:04.547352 bus /gobi_6: Setting Powered False 08:40:05.609821 run create_hlr_db(pid=26958): Terminated: ok {rc=0} 08:40:06.047860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Launched 08:40:06.365592 run osmo-hlr_10.42.42.2(pid=26961): Launched 08:40:06.486812 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:07.039459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Launched 08:40:07.357272 run osmo-stp_10.42.42.5(pid=26964): Launched 08:40:07.477954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:08.035581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Launched 08:40:08.155788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:08.422880 run patchelf(pid=26967): Launched 08:40:08.598945 run osmo-stp_10.42.42.5(pid=26964): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] 08:40:08.732020 run osmo-stp_10.42.42.5(pid=26964): stdout: | (launched: 2022-12-13_08:40:07.297835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:08.866966 run osmo-stp_10.42.42.5(pid=26964): stderr: | 20221213084007474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084007475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084007475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084007475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084007476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084007476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084007476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:09.001711 run osmo-stp_10.42.42.5(pid=26964): stdout: | (launched: 2022-12-13_08:40:07.297835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:09.130593 run osmo-stp_10.42.42.5(pid=26964): stderr: | 20221213084007474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084007475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084007475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084007475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084007476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084007476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084007476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:09.282801 run patchelf(pid=26967): Terminating (SIGINT) 08:40:09.458763 run patchelf(pid=26967): Terminated: ok {rc=0} 08:40:09.586068 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26964): Process ended prematurely: osmo-stp_10.42.42.5(pid=26964) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 08:40:09.595569 tst iperf3.py:8: Test FAILED (7.6 sec) 08:40:09.622906 run osmo-hlr_10.42.42.2(pid=26961): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26961)] 08:40:09.671703 run osmo-hlr_10.42.42.2(pid=26961): stdout: | (launched: 2022-12-13_08:40:06.306253) 08:40:09.721775 run osmo-hlr_10.42.42.2(pid=26961): stderr: | 20221213084006489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084006489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084006489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084006489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084006489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084006489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084006500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084006508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084006508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084006508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:09.772188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26956): Terminating (SIGTERM) 08:40:09.812839 run iperf3-srv_10.42.42.10(pid=26957): Terminating (SIGTERM) 08:40:09.853360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Terminating (SIGTERM) 08:40:09.893976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Terminating (SIGTERM) 08:40:09.934385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Terminating (SIGTERM) 08:40:09.975134 --- ParallelTerminationStrategy: PID 26956 died... 08:40:09.995152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26956): Terminated: ok {rc=0} 08:40:10.039922 --- ParallelTerminationStrategy: PID 26957 died... 08:40:10.059183 run iperf3-srv_10.42.42.10(pid=26957): Terminated {rc=256} 08:40:10.103784 --- ParallelTerminationStrategy: PID 26960 died... 08:40:10.123147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26960): Terminated: ok {rc=0} 08:40:10.167844 --- ParallelTerminationStrategy: PID 26963 died... 08:40:10.187256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26963): Terminated: ok {rc=0} 08:40:10.231762 --- ParallelTerminationStrategy: PID 26966 died... 08:40:10.251068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26966): Terminated: ok {rc=0} 08:40:10.336385 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:40:11.488180 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:11.503401 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:11.539956 tst iperf3m4.py: using LAC 32769 08:40:11.671761 tst iperf3m4.py: using RAC 129 08:40:11.802793 tst iperf3m4.py: using CellId 32769 08:40:11.931997 tst iperf3m4.py: using BVCI 32770 08:40:12.055344 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.066833 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.078138 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.089268 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.100321 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.111394 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.122838 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.133872 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:12.145105 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:12.267212 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:12.390103 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:12.512593 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:12.633040 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:40:12.861509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:13.201649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26968): Launched 08:40:13.495441 run iperf3-srv_10.42.42.10(pid=26969): Launched 08:40:13.622187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:40:13.850270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:14.189238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26970): Launched 08:40:14.484431 run iperf3-srv_10.42.42.10(pid=26971): Launched 08:40:14.612012 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:40:14.838666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:15.177644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26972): Launched 08:40:15.471972 run iperf3-srv_10.42.42.10(pid=26973): Launched 08:40:15.598261 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:40:15.826132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:16.214346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26974): Launched 08:40:16.513768 run iperf3-srv_10.42.42.10(pid=26975): Launched 08:40:16.652172 tst iperf3m4.py:8: start network... 08:40:16.875986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:17.386927 run create_hlr_db(pid=26976): Launched 08:40:17.520176 bus /gobi_6: Setting Powered False 08:40:18.583282 run create_hlr_db(pid=26976): Terminated: ok {rc=0} 08:40:19.041679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26978): Launched 08:40:19.379195 run osmo-hlr_10.42.42.2(pid=26979): Launched 08:40:19.506673 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:20.090917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26981): Launched 08:40:20.428428 run osmo-stp_10.42.42.5(pid=26982): Launched 08:40:20.555849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:21.137451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26984): Launched 08:40:21.258210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:21.526464 run patchelf(pid=26985): Launched 08:40:21.701268 run osmo-stp_10.42.42.5(pid=26982): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26982)] 08:40:21.834516 run osmo-stp_10.42.42.5(pid=26982): stdout: | (launched: 2022-12-13_08:40:20.365343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:21.969220 run osmo-stp_10.42.42.5(pid=26982): stderr: | 20221213084020562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084020562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084020562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084020562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084020565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084020565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084020565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:22.103718 run osmo-stp_10.42.42.5(pid=26982): stdout: | (launched: 2022-12-13_08:40:20.365343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:22.232418 run osmo-stp_10.42.42.5(pid=26982): stderr: | 20221213084020562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084020562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084020562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084020562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084020565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084020565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084020565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:22.385482 run patchelf(pid=26985): Terminating (SIGINT) 08:40:22.561729 run patchelf(pid=26985): Terminated: ok {rc=0} 08:40:22.688823 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26982): Process ended prematurely: osmo-stp_10.42.42.5(pid=26982) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26982)] [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 08:40:22.698470 tst iperf3m4.py:8: Test FAILED (11.3 sec) 08:40:22.726217 run osmo-hlr_10.42.42.2(pid=26979): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26979)] 08:40:22.775547 run osmo-hlr_10.42.42.2(pid=26979): stdout: | (launched: 2022-12-13_08:40:19.315605) 08:40:22.826425 run osmo-hlr_10.42.42.2(pid=26979): stderr: | 20221213084019518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084019518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084019518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084019518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084019518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084019518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084019530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084019540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084019540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084019540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:22.877629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26968): Terminating (SIGTERM) 08:40:22.918543 run iperf3-srv_10.42.42.10(pid=26969): Terminating (SIGTERM) 08:40:22.959383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26970): Terminating (SIGTERM) 08:40:23.000306 run iperf3-srv_10.42.42.10(pid=26971): Terminating (SIGTERM) 08:40:23.041097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26972): Terminating (SIGTERM) 08:40:23.082517 run iperf3-srv_10.42.42.10(pid=26973): Terminating (SIGTERM) 08:40:23.123354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26974): Terminating (SIGTERM) 08:40:23.164087 run iperf3-srv_10.42.42.10(pid=26975): Terminating (SIGTERM) 08:40:23.204560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26978): Terminating (SIGTERM) 08:40:23.245334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26981): Terminating (SIGTERM) 08:40:23.285482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26984): Terminating (SIGTERM) 08:40:23.325805 --- ParallelTerminationStrategy: PID 26968 died... 08:40:23.345618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26968): Terminated: ok {rc=0} 08:40:23.390544 --- ParallelTerminationStrategy: PID 26969 died... 08:40:23.409898 run iperf3-srv_10.42.42.10(pid=26969): Terminated {rc=256} 08:40:23.454295 --- ParallelTerminationStrategy: PID 26970 died... 08:40:23.473421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26970): Terminated: ok {rc=0} 08:40:23.518068 --- ParallelTerminationStrategy: PID 26971 died... 08:40:23.537272 run iperf3-srv_10.42.42.10(pid=26971): Terminated {rc=256} 08:40:23.581223 --- ParallelTerminationStrategy: PID 26972 died... 08:40:23.600164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26972): Terminated: ok {rc=0} 08:40:23.645275 --- ParallelTerminationStrategy: PID 26973 died... 08:40:23.664571 run iperf3-srv_10.42.42.10(pid=26973): Terminated {rc=256} 08:40:23.709283 --- ParallelTerminationStrategy: PID 26974 died... 08:40:23.728484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26974): Terminated: ok {rc=0} 08:40:23.773698 --- ParallelTerminationStrategy: PID 26975 died... 08:40:23.793160 run iperf3-srv_10.42.42.10(pid=26975): Terminated {rc=256} 08:40:23.837525 --- ParallelTerminationStrategy: PID 26978 died... 08:40:23.856686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26978): Terminated: ok {rc=0} 08:40:23.901095 --- ParallelTerminationStrategy: PID 26981 died... 08:40:23.920232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26981): Terminated: ok {rc=0} 08:40:23.965130 --- ParallelTerminationStrategy: PID 26984 died... 08:40:23.984349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26984): Terminated: ok {rc=0} 08:40:24.071308 bus /gobi_4: Setting Powered False 08:40:25.171195 bus /gobi_4: Setting Powered False 08:40:26.285600 bus /gobi_1: Setting Powered False 08:40:27.385254 bus /gobi_1: Setting Powered False 08:40:28.503352 bus /gobi_0: Setting Powered False 08:40:29.602134 bus /gobi_0: Setting Powered False 08:40:30.716306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 08:40:31.831207 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:31.844311 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:31.883292 tst ping.py: using LAC 32770 08:40:32.058608 tst ping.py: using RAC 130 08:40:32.221044 tst ping.py: using CellId 32770 08:40:32.370844 tst ping.py: using BVCI 32771 08:40:32.491777 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:32.503333 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:32.514900 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:32.526339 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:32.537629 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:32.548792 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:32.560145 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:32.571339 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:32.694705 tst ping.py:19: start network... 08:40:32.916837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:33.429576 run create_hlr_db(pid=26986): Launched 08:40:33.549222 bus /gobi_6: Setting Powered False 08:40:34.610607 run create_hlr_db(pid=26986): Terminated: ok {rc=0} 08:40:35.063423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26988): Launched 08:40:35.396374 run osmo-hlr_10.42.42.2(pid=26989): Launched 08:40:35.522616 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:36.093860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26991): Launched 08:40:36.424507 run osmo-stp_10.42.42.5(pid=26992): Launched 08:40:36.549695 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:37.121966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26994): Launched 08:40:37.248329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:37.530359 run patchelf(pid=26995): Launched 08:40:37.715728 run osmo-stp_10.42.42.5(pid=26992): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26992)] 08:40:37.855668 run osmo-stp_10.42.42.5(pid=26992): stdout: | (launched: 2022-12-13_08:40:36.362818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:37.996618 run osmo-stp_10.42.42.5(pid=26992): stderr: | 20221213084036557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084036558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084036558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084036558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084036559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084036559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084036559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:38.137389 run osmo-stp_10.42.42.5(pid=26992): stdout: | (launched: 2022-12-13_08:40:36.362818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:38.273277 run osmo-stp_10.42.42.5(pid=26992): stderr: | 20221213084036557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084036558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084036558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084036558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084036559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084036559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084036559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:38.434591 run patchelf(pid=26995): Terminating (SIGINT) 08:40:38.618744 run patchelf(pid=26995): Terminated: ok {rc=0} 08:40:38.751249 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26992): Process ended prematurely: osmo-stp_10.42.42.5(pid=26992) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26992)] [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 08:40:38.760786 tst ping.py:22: Test FAILED (6.9 sec) 08:40:38.789387 run osmo-hlr_10.42.42.2(pid=26989): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26989)] 08:40:38.839854 run osmo-hlr_10.42.42.2(pid=26989): stdout: | (launched: 2022-12-13_08:40:35.333411) 08:40:38.891815 run osmo-hlr_10.42.42.2(pid=26989): stderr: | 20221213084035535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084035536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084035536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084035536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084035536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084035536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084035550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084035560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084035560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084035560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:38.944356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26988): Terminating (SIGTERM) 08:40:38.986225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26991): Terminating (SIGTERM) 08:40:39.028005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26994): Terminating (SIGTERM) 08:40:39.070133 --- ParallelTerminationStrategy: PID 26988 died... 08:40:39.090323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26988): Terminated: ok {rc=0} 08:40:39.136539 --- ParallelTerminationStrategy: PID 26991 died... 08:40:39.156022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26991): Terminated: ok {rc=0} 08:40:39.202496 --- ParallelTerminationStrategy: PID 26994 died... 08:40:39.222181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26994): Terminated: ok {rc=0} 08:40:39.310439 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:40:40.398249 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:40.410571 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:40.449709 tst ping_idle_ping.py: using LAC 32771 08:40:40.580136 tst ping_idle_ping.py: using RAC 131 08:40:40.702682 tst ping_idle_ping.py: using CellId 32771 08:40:40.829751 tst ping_idle_ping.py: using BVCI 32772 08:40:40.943965 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:40.955087 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:40.966133 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:40.976770 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:40.987828 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:40.998654 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:41.009997 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:41.021044 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:41.145521 tst ping_idle_ping.py:24: start network... 08:40:41.354460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:41.836604 run create_hlr_db(pid=26996): Launched 08:40:41.956016 bus /gobi_6: Setting Powered False 08:40:43.016812 run create_hlr_db(pid=26996): Terminated: ok {rc=0} 08:40:43.470918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26998): Launched 08:40:43.787964 run osmo-hlr_10.42.42.2(pid=26999): Launched 08:40:43.906644 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:44.456637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27001): Launched 08:40:44.768563 run osmo-stp_10.42.42.5(pid=27002): Launched 08:40:44.887875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:45.426082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27004): Launched 08:40:45.544878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:45.809075 run patchelf(pid=27005): Launched 08:40:46.002864 run osmo-stp_10.42.42.5(pid=27002): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27002)] 08:40:46.147942 run osmo-stp_10.42.42.5(pid=27002): stdout: | (launched: 2022-12-13_08:40:44.710023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:46.292601 run osmo-stp_10.42.42.5(pid=27002): stderr: | 20221213084044884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084044885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084044885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084044885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084044886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084044886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084044886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:46.437579 run osmo-stp_10.42.42.5(pid=27002): stdout: | (launched: 2022-12-13_08:40:44.710023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:46.576210 run osmo-stp_10.42.42.5(pid=27002): stderr: | 20221213084044884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084044885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084044885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084044885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084044886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084044886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084044886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:46.741826 run patchelf(pid=27005): Terminating (SIGINT) 08:40:46.931525 run patchelf(pid=27005): Terminated: ok {rc=0} 08:40:47.067978 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27002): Process ended prematurely: osmo-stp_10.42.42.5(pid=27002) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27002)] [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 08:40:47.078803 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:40:47.108460 run osmo-hlr_10.42.42.2(pid=26999): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26999)] 08:40:47.160889 run osmo-hlr_10.42.42.2(pid=26999): stdout: | (launched: 2022-12-13_08:40:43.729390) 08:40:47.213802 run osmo-hlr_10.42.42.2(pid=26999): stderr: | 20221213084043909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084043909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084043909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084043909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084043909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084043909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084043922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084043930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084043930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084043930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:47.268131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26998): Terminating (SIGTERM) 08:40:47.310836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27001): Terminating (SIGTERM) 08:40:47.353860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27004): Terminating (SIGTERM) 08:40:47.397353 --- ParallelTerminationStrategy: PID 26998 died... 08:40:47.418166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26998): Terminated: ok {rc=0} 08:40:47.464875 --- ParallelTerminationStrategy: PID 27001 died... 08:40:47.485090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27001): Terminated: ok {rc=0} 08:40:47.531358 --- ParallelTerminationStrategy: PID 27004 died... 08:40:47.551023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27004): Terminated: ok {rc=0} 08:40:47.639152 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:40:48.936036 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:48.943580 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:40:48.964683 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:40:49.004891 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:40:49.093043 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:40:49.113954 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:40:49.152943 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:40:49.744681 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:40:49.796881 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:49.808072 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:40:49.865796 tst cs_paging_gprs_active.py: using LAC 32772 08:40:49.999365 tst cs_paging_gprs_active.py: using RAC 132 08:40:50.135646 tst cs_paging_gprs_active.py: using CellId 32772 08:40:50.267692 tst cs_paging_gprs_active.py: using BVCI 32773 08:40:50.384767 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.396248 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.407681 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.418677 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.430053 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.441436 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.453075 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.464518 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:40:50.476069 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:40:50.600216 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:40:50.721506 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:40:50.935762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:51.253731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27009): Launched 08:40:51.531764 run iperf3-srv_10.42.42.10(pid=27010): Launched 08:40:51.652242 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:40:51.865913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:52.209929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27013): Launched 08:40:52.505630 run iperf3-srv_10.42.42.10(pid=27014): Launched 08:40:52.633688 tst cs_paging_gprs_active.py:38: start network... 08:40:52.861064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:53.385360 run create_hlr_db(pid=27015): Launched 08:40:53.523987 bus /gobi_6: Setting Powered False 08:40:54.590990 run create_hlr_db(pid=27015): Terminated: ok {rc=0} 08:40:55.042247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Launched 08:40:55.362158 run osmo-hlr_10.42.42.2(pid=27018): Launched 08:40:55.484645 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:56.040562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Launched 08:40:56.357262 run osmo-stp_10.42.42.5(pid=27021): Launched 08:40:56.479756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:57.025133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27023): Launched 08:40:57.147423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:57.415074 run patchelf(pid=27024): Launched 08:40:57.591666 run osmo-stp_10.42.42.5(pid=27021): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] 08:40:57.725133 run osmo-stp_10.42.42.5(pid=27021): stdout: | (launched: 2022-12-13_08:40:56.297830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:57.860314 run osmo-stp_10.42.42.5(pid=27021): stderr: | 20221213084056472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084056473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084056473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084056473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084056475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084056476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084056476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:57.995309 run osmo-stp_10.42.42.5(pid=27021): stdout: | (launched: 2022-12-13_08:40:56.297830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:58.124504 run osmo-stp_10.42.42.5(pid=27021): stderr: | 20221213084056472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084056473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084056473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084056473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084056475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084056476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084056476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:58.277398 run patchelf(pid=27024): Terminating (SIGINT) 08:40:58.454768 run patchelf(pid=27024): Terminated: ok {rc=0} 08:40:58.582436 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27021): Process ended prematurely: osmo-stp_10.42.42.5(pid=27021) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:40:58.591857 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:40:58.619185 run osmo-hlr_10.42.42.2(pid=27018): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27018)] 08:40:58.668451 run osmo-hlr_10.42.42.2(pid=27018): stdout: | (launched: 2022-12-13_08:40:55.302512) 08:40:58.718660 run osmo-hlr_10.42.42.2(pid=27018): stderr: | 20221213084055484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084055485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084055485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084055485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084055485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084055485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084055497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084055505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084055505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084055505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:58.769185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27009): Terminating (SIGTERM) 08:40:58.809513 run iperf3-srv_10.42.42.10(pid=27010): Terminating (SIGTERM) 08:40:58.849950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27013): Terminating (SIGTERM) 08:40:58.890334 run iperf3-srv_10.42.42.10(pid=27014): Terminating (SIGTERM) 08:40:58.930714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Terminating (SIGTERM) 08:40:58.971344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Terminating (SIGTERM) 08:40:59.011649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27023): Terminating (SIGTERM) 08:40:59.052207 --- ParallelTerminationStrategy: PID 27009 died... 08:40:59.071941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27009): Terminated: ok {rc=0} 08:40:59.116788 --- ParallelTerminationStrategy: PID 27010 died... 08:40:59.135822 run iperf3-srv_10.42.42.10(pid=27010): Terminated {rc=256} 08:40:59.180162 --- ParallelTerminationStrategy: PID 27013 died... 08:40:59.199244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27013): Terminated: ok {rc=0} 08:40:59.243541 --- ParallelTerminationStrategy: PID 27014 died... 08:40:59.262500 run iperf3-srv_10.42.42.10(pid=27014): Terminated {rc=256} 08:40:59.306856 --- ParallelTerminationStrategy: PID 27017 died... 08:40:59.325885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27017): Terminated: ok {rc=0} 08:40:59.370318 --- ParallelTerminationStrategy: PID 27020 died... 08:40:59.389375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27020): Terminated: ok {rc=0} 08:40:59.433656 --- ParallelTerminationStrategy: PID 27023 died... 08:40:59.452743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27023): Terminated: ok {rc=0} 08:40:59.539789 bus /gobi_0: Setting Powered False 08:41:00.640270 bus /gobi_0: Setting Powered False 08:41:01.754549 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:41:02.901021 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:02.912560 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:02.973435 tst iperf3.py: using LAC 32773 08:41:03.098584 tst iperf3.py: using RAC 133 08:41:03.223189 tst iperf3.py: using CellId 32773 08:41:03.347669 tst iperf3.py: using BVCI 32774 08:41:03.463294 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.474431 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.485357 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.496003 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.506871 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.518456 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.530152 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.541160 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:03.552173 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:03.674905 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:41:03.902934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:04.241727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27025): Launched 08:41:04.536505 run iperf3-srv_10.42.42.10(pid=27026): Launched 08:41:04.664505 tst iperf3.py:8: start network... 08:41:04.892278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:05.415137 run create_hlr_db(pid=27027): Launched 08:41:05.551391 bus /gobi_6: Setting Powered False 08:41:06.613780 run create_hlr_db(pid=27027): Terminated: ok {rc=0} 08:41:07.061989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27029): Launched 08:41:07.380002 run osmo-hlr_10.42.42.2(pid=27030): Launched 08:41:07.499978 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:08.059507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27032): Launched 08:41:08.377589 run osmo-stp_10.42.42.5(pid=27033): Launched 08:41:08.497472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:09.039942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27035): Launched 08:41:09.159981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:09.427953 run patchelf(pid=27036): Launched 08:41:09.602435 run osmo-stp_10.42.42.5(pid=27033): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27033)] 08:41:09.735014 run osmo-stp_10.42.42.5(pid=27033): stdout: | (launched: 2022-12-13_08:41:08.318359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:09.871138 run osmo-stp_10.42.42.5(pid=27033): stderr: | 20221213084108493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084108493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084108493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084108493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084108494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084108494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084108494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:10.007493 run osmo-stp_10.42.42.5(pid=27033): stdout: | (launched: 2022-12-13_08:41:08.318359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:10.140027 run osmo-stp_10.42.42.5(pid=27033): stderr: | 20221213084108493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084108493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084108493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084108493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084108494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084108494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084108494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:10.297167 run patchelf(pid=27036): Terminating (SIGINT) 08:41:10.477911 run patchelf(pid=27036): Terminated: ok {rc=0} 08:41:10.606007 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27033): Process ended prematurely: osmo-stp_10.42.42.5(pid=27033) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27033)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 08:41:10.615501 tst iperf3.py:8: Test FAILED (7.8 sec) 08:41:10.642837 run osmo-hlr_10.42.42.2(pid=27030): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27030)] 08:41:10.690997 run osmo-hlr_10.42.42.2(pid=27030): stdout: | (launched: 2022-12-13_08:41:07.320430) 08:41:10.741224 run osmo-hlr_10.42.42.2(pid=27030): stderr: | 20221213084107503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084107503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084107503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084107503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084107503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084107503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084107515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084107525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084107525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084107525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:10.791279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27025): Terminating (SIGTERM) 08:41:10.831575 run iperf3-srv_10.42.42.10(pid=27026): Terminating (SIGTERM) 08:41:10.871763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27029): Terminating (SIGTERM) 08:41:10.912095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27032): Terminating (SIGTERM) 08:41:10.952154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27035): Terminating (SIGTERM) 08:41:10.992488 --- ParallelTerminationStrategy: PID 27025 died... 08:41:11.012112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27025): Terminated: ok {rc=0} 08:41:11.056537 --- ParallelTerminationStrategy: PID 27026 died... 08:41:11.075616 run iperf3-srv_10.42.42.10(pid=27026): Terminated {rc=256} 08:41:11.119838 --- ParallelTerminationStrategy: PID 27029 died... 08:41:11.138910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27029): Terminated: ok {rc=0} 08:41:11.183202 --- ParallelTerminationStrategy: PID 27032 died... 08:41:11.202201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27032): Terminated: ok {rc=0} 08:41:11.247660 --- ParallelTerminationStrategy: PID 27035 died... 08:41:11.266688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27035): Terminated: ok {rc=0} 08:41:11.350781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:41:12.502171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:12.517875 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:12.575234 tst iperf3m4.py: using LAC 32774 08:41:12.708529 tst iperf3m4.py: using RAC 134 08:41:12.840499 tst iperf3m4.py: using CellId 32774 08:41:12.973145 tst iperf3m4.py: using BVCI 32775 08:41:13.095312 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.107059 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.118626 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.130073 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.141432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.152739 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.164503 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.175903 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:13.187531 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:13.310580 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:13.433816 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:13.553549 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:13.673661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:41:13.902701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:14.243801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27037): Launched 08:41:14.539246 run iperf3-srv_10.42.42.10(pid=27038): Launched 08:41:14.665622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:41:14.893340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:15.233299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27039): Launched 08:41:15.528128 run iperf3-srv_10.42.42.10(pid=27040): Launched 08:41:15.654536 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:41:15.881836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:16.253958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Launched 08:41:16.586092 run iperf3-srv_10.42.42.10(pid=27042): Launched 08:41:16.728547 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:41:16.960574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:17.306665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Launched 08:41:17.611202 run iperf3-srv_10.42.42.10(pid=27044): Launched 08:41:17.736937 tst iperf3m4.py:8: start network... 08:41:17.963347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:18.486433 run create_hlr_db(pid=27045): Launched 08:41:18.622399 bus /gobi_6: Setting Powered False 08:41:19.687925 run create_hlr_db(pid=27045): Terminated: ok {rc=0} 08:41:20.135192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Launched 08:41:20.452334 run osmo-hlr_10.42.42.2(pid=27048): Launched 08:41:20.573888 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:21.132378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27050): Launched 08:41:21.470203 run osmo-stp_10.42.42.5(pid=27051): Launched 08:41:21.597815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:22.176433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27053): Launched 08:41:22.303945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:22.588209 run patchelf(pid=27054): Launched 08:41:22.773192 run osmo-stp_10.42.42.5(pid=27051): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27051)] 08:41:22.913902 run osmo-stp_10.42.42.5(pid=27051): stdout: | (launched: 2022-12-13_08:41:21.407014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:23.056381 run osmo-stp_10.42.42.5(pid=27051): stderr: | 20221213084121604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084121604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084121604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084121605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084121605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084121605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084121605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:23.198615 run osmo-stp_10.42.42.5(pid=27051): stdout: | (launched: 2022-12-13_08:41:21.407014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:23.335281 run osmo-stp_10.42.42.5(pid=27051): stderr: | 20221213084121604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084121604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084121604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084121605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084121605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084121605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084121605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:23.498409 run patchelf(pid=27054): Terminating (SIGINT) 08:41:23.684706 run patchelf(pid=27054): Terminated: ok {rc=0} 08:41:23.819333 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27051): Process ended prematurely: osmo-stp_10.42.42.5(pid=27051) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27051)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:41:23.829526 tst iperf3m4.py:8: Test FAILED (11.4 sec) 08:41:23.858234 run osmo-hlr_10.42.42.2(pid=27048): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27048)] 08:41:23.908149 run osmo-hlr_10.42.42.2(pid=27048): stdout: | (launched: 2022-12-13_08:41:20.392737) 08:41:23.960042 run osmo-hlr_10.42.42.2(pid=27048): stderr: | 20221213084120574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084120574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084120574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084120574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084120574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084120574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084120586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084120594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084120594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084120594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:24.012117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27037): Terminating (SIGTERM) 08:41:24.054260 run iperf3-srv_10.42.42.10(pid=27038): Terminating (SIGTERM) 08:41:24.096400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27039): Terminating (SIGTERM) 08:41:24.138643 run iperf3-srv_10.42.42.10(pid=27040): Terminating (SIGTERM) 08:41:24.180802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Terminating (SIGTERM) 08:41:24.223332 run iperf3-srv_10.42.42.10(pid=27042): Terminating (SIGTERM) 08:41:24.265469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Terminating (SIGTERM) 08:41:24.307662 run iperf3-srv_10.42.42.10(pid=27044): Terminating (SIGTERM) 08:41:24.349703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Terminating (SIGTERM) 08:41:24.392251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27050): Terminating (SIGTERM) 08:41:24.434579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27053): Terminating (SIGTERM) 08:41:24.477089 --- ParallelTerminationStrategy: PID 27037 died... 08:41:24.497456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27037): Terminated: ok {rc=0} 08:41:24.544205 --- ParallelTerminationStrategy: PID 27038 died... 08:41:24.564052 run iperf3-srv_10.42.42.10(pid=27038): Terminated {rc=256} 08:41:24.610344 --- ParallelTerminationStrategy: PID 27039 died... 08:41:24.630187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27039): Terminated: ok {rc=0} 08:41:24.676505 --- ParallelTerminationStrategy: PID 27040 died... 08:41:24.696028 run iperf3-srv_10.42.42.10(pid=27040): Terminated {rc=256} 08:41:24.742340 --- ParallelTerminationStrategy: PID 27041 died... 08:41:24.762090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27041): Terminated: ok {rc=0} 08:41:24.808444 --- ParallelTerminationStrategy: PID 27042 died... 08:41:24.828093 run iperf3-srv_10.42.42.10(pid=27042): Terminated {rc=256} 08:41:24.874404 --- ParallelTerminationStrategy: PID 27043 died... 08:41:24.894117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27043): Terminated: ok {rc=0} 08:41:24.940406 --- ParallelTerminationStrategy: PID 27044 died... 08:41:24.960141 run iperf3-srv_10.42.42.10(pid=27044): Terminated {rc=256} 08:41:25.006070 --- ParallelTerminationStrategy: PID 27047 died... 08:41:25.025901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27047): Terminated: ok {rc=0} 08:41:25.072204 --- ParallelTerminationStrategy: PID 27050 died... 08:41:25.091914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27050): Terminated: ok {rc=0} 08:41:25.138682 --- ParallelTerminationStrategy: PID 27053 died... 08:41:25.158392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27053): Terminated: ok {rc=0} 08:41:25.247365 bus /gobi_4: Setting Powered False 08:41:26.346634 bus /gobi_4: Setting Powered False 08:41:27.463662 bus /gobi_1: Setting Powered False 08:41:28.563610 bus /gobi_1: Setting Powered False 08:41:29.682507 bus /gobi_0: Setting Powered False 08:41:30.780857 bus /gobi_0: Setting Powered False 08:41:31.903010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:41:33.017335 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.029249 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:33.087169 tst ping.py: using LAC 32775 08:41:33.209357 tst ping.py: using RAC 135 08:41:33.332200 tst ping.py: using CellId 32775 08:41:33.454637 tst ping.py: using BVCI 32776 08:41:33.569250 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.580136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.590841 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.601605 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.612504 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.624001 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.635179 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:33.646178 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:33.763745 tst ping.py:19: start network... 08:41:33.971323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:34.453036 run create_hlr_db(pid=27055): Launched 08:41:34.571192 bus /gobi_6: Setting Powered False 08:41:35.632547 run create_hlr_db(pid=27055): Terminated: ok {rc=0} 08:41:36.067039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27057): Launched 08:41:36.380116 run osmo-hlr_10.42.42.2(pid=27058): Launched 08:41:36.498775 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:37.058971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27060): Launched 08:41:37.370199 run osmo-stp_10.42.42.5(pid=27061): Launched 08:41:37.488760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:38.024050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27063): Launched 08:41:38.143185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:38.406925 run patchelf(pid=27064): Launched 08:41:38.578371 run osmo-stp_10.42.42.5(pid=27061): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27061)] 08:41:38.708821 run osmo-stp_10.42.42.5(pid=27061): stdout: | (launched: 2022-12-13_08:41:37.311353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:38.841178 run osmo-stp_10.42.42.5(pid=27061): stderr: | 20221213084137486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084137487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084137487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084137487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084137488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084137488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084137488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:38.973587 run osmo-stp_10.42.42.5(pid=27061): stdout: | (launched: 2022-12-13_08:41:37.311353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:39.100195 run osmo-stp_10.42.42.5(pid=27061): stderr: | 20221213084137486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084137487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084137487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084137487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084137488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084137488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084137488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:39.249864 run patchelf(pid=27064): Terminating (SIGINT) 08:41:39.422120 run patchelf(pid=27064): Terminated: ok {rc=0} 08:41:39.546582 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27061): Process ended prematurely: osmo-stp_10.42.42.5(pid=27061) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27061)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 08:41:39.555444 tst ping.py:22: Test FAILED (6.5 sec) 08:41:39.582246 run osmo-hlr_10.42.42.2(pid=27058): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27058)] 08:41:39.630498 run osmo-hlr_10.42.42.2(pid=27058): stdout: | (launched: 2022-12-13_08:41:36.320633) 08:41:39.680040 run osmo-hlr_10.42.42.2(pid=27058): stderr: | 20221213084136501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084136501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084136501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084136501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084136501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084136501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084136513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084136522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084136522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084136522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:39.729977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27057): Terminating (SIGTERM) 08:41:39.770127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27060): Terminating (SIGTERM) 08:41:39.810221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27063): Terminating (SIGTERM) 08:41:39.850614 --- ParallelTerminationStrategy: PID 27057 died... 08:41:39.870262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27057): Terminated: ok {rc=0} 08:41:39.914625 --- ParallelTerminationStrategy: PID 27060 died... 08:41:39.933656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27060): Terminated: ok {rc=0} 08:41:39.978173 --- ParallelTerminationStrategy: PID 27063 died... 08:41:39.997284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27063): Terminated: ok {rc=0} 08:41:40.084164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:41:41.173254 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.184727 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:41.244020 tst ping_idle_ping.py: using LAC 32776 08:41:41.366278 tst ping_idle_ping.py: using RAC 136 08:41:41.488924 tst ping_idle_ping.py: using CellId 32776 08:41:41.610253 tst ping_idle_ping.py: using BVCI 32777 08:41:41.725242 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.736075 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.746882 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.757672 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.768388 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.782397 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.794320 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:41.806044 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:41.924551 tst ping_idle_ping.py:24: start network... 08:41:42.138322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:42.602605 run create_hlr_db(pid=27065): Launched 08:41:42.715792 bus /gobi_6: Setting Powered False 08:41:43.775088 run create_hlr_db(pid=27065): Terminated: ok {rc=0} 08:41:44.213491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27067): Launched 08:41:44.536755 run osmo-hlr_10.42.42.2(pid=27068): Launched 08:41:44.659477 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:45.210889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27070): Launched 08:41:45.531558 run osmo-stp_10.42.42.5(pid=27071): Launched 08:41:45.653570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:46.254749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27073): Launched 08:41:46.388929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:46.666519 run patchelf(pid=27074): Launched 08:41:46.858854 run osmo-stp_10.42.42.5(pid=27071): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27071)] 08:41:47.021339 run osmo-stp_10.42.42.5(pid=27071): stdout: | (launched: 2022-12-13_08:41:45.471925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:47.165927 run osmo-stp_10.42.42.5(pid=27071): stderr: | 20221213084145665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084145665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084145665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084145666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084145666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084145666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084145666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:47.305263 run osmo-stp_10.42.42.5(pid=27071): stdout: | (launched: 2022-12-13_08:41:45.471925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:47.437862 run osmo-stp_10.42.42.5(pid=27071): stderr: | 20221213084145665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084145665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084145665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084145666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084145666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084145666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084145666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:47.593848 run patchelf(pid=27074): Terminating (SIGINT) 08:41:47.772150 run patchelf(pid=27074): Terminated: ok {rc=0} 08:41:47.901400 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27071): Process ended prematurely: osmo-stp_10.42.42.5(pid=27071) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27071)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:41:47.911106 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:41:47.939138 run osmo-hlr_10.42.42.2(pid=27068): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27068)] 08:41:47.989761 run osmo-hlr_10.42.42.2(pid=27068): stdout: | (launched: 2022-12-13_08:41:44.476798) 08:41:48.041733 run osmo-hlr_10.42.42.2(pid=27068): stderr: | 20221213084144678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084144678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084144678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084144678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084144678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084144678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084144689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084144697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084144697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084144697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:48.094243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27067): Terminating (SIGTERM) 08:41:48.136358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27070): Terminating (SIGTERM) 08:41:48.178435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27073): Terminating (SIGTERM) 08:41:48.220515 --- ParallelTerminationStrategy: PID 27067 died... 08:41:48.240718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27067): Terminated: ok {rc=0} 08:41:48.286923 --- ParallelTerminationStrategy: PID 27070 died... 08:41:48.306723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27070): Terminated: ok {rc=0} 08:41:48.353127 --- ParallelTerminationStrategy: PID 27073 died... 08:41:48.372912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27073): Terminated: ok {rc=0} 08:41:48.461397 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:41:49.750312 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:49.756158 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:41:49.776478 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:41:49.814590 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:41:49.898928 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:41:49.919347 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:41:49.957719 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:41:50.555193 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:41:50.605916 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:50.616555 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:41:50.670914 tst cs_paging_gprs_active.py: using LAC 32777 08:41:50.788005 tst cs_paging_gprs_active.py: using RAC 137 08:41:50.904808 tst cs_paging_gprs_active.py: using CellId 32777 08:41:51.022114 tst cs_paging_gprs_active.py: using BVCI 32778 08:41:51.133585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.144381 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.155016 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.166083 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.176859 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.188256 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.199212 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.210108 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:41:51.220917 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:41:51.341734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:41:51.460611 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:41:51.681895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:52.008887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27080): Launched 08:41:52.291549 run iperf3-srv_10.42.42.10(pid=27081): Launched 08:41:52.413128 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:41:52.632130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:52.958113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27083): Launched 08:41:53.240505 run iperf3-srv_10.42.42.10(pid=27084): Launched 08:41:53.361987 tst cs_paging_gprs_active.py:38: start network... 08:41:53.580288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:54.083525 run create_hlr_db(pid=27085): Launched 08:41:54.214886 bus /gobi_6: Setting Powered False 08:41:55.279709 run create_hlr_db(pid=27085): Terminated: ok {rc=0} 08:41:55.713194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27087): Launched 08:41:56.016139 run osmo-hlr_10.42.42.2(pid=27088): Launched 08:41:56.132514 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:56.669092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27090): Launched 08:41:56.971044 run osmo-stp_10.42.42.5(pid=27091): Launched 08:41:57.095941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:57.620108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27095): Launched 08:41:57.736170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:57.992808 run patchelf(pid=27096): Launched 08:41:58.161048 run osmo-stp_10.42.42.5(pid=27091): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27091)] 08:41:58.289231 run osmo-stp_10.42.42.5(pid=27091): stdout: | (launched: 2022-12-13_08:41:56.914469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:58.418937 run osmo-stp_10.42.42.5(pid=27091): stderr: | 20221213084157104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084157104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084157104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084157105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084157105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084157105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084157106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:58.548844 run osmo-stp_10.42.42.5(pid=27091): stdout: | (launched: 2022-12-13_08:41:56.914469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:58.672926 run osmo-stp_10.42.42.5(pid=27091): stderr: | 20221213084157104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084157104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084157104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084157105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084157105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084157105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084157106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:58.819880 run patchelf(pid=27096): Terminating (SIGINT) 08:41:58.989831 run patchelf(pid=27096): Terminated: ok {rc=0} 08:41:59.112602 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27091): Process ended prematurely: osmo-stp_10.42.42.5(pid=27091) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27091)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:41:59.122196 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:41:59.148914 run osmo-hlr_10.42.42.2(pid=27088): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27088)] 08:41:59.197103 run osmo-hlr_10.42.42.2(pid=27088): stdout: | (launched: 2022-12-13_08:41:55.959523) 08:41:59.246255 run osmo-hlr_10.42.42.2(pid=27088): stderr: | 20221213084156139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084156139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084156139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084156139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084156139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084156139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084156151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084156159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084156160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084156160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:59.295713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27080): Terminating (SIGTERM) 08:41:59.335576 run iperf3-srv_10.42.42.10(pid=27081): Terminating (SIGTERM) 08:41:59.375812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27083): Terminating (SIGTERM) 08:41:59.415701 run iperf3-srv_10.42.42.10(pid=27084): Terminating (SIGTERM) 08:41:59.455159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27087): Terminating (SIGTERM) 08:41:59.494739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27090): Terminating (SIGTERM) 08:41:59.534204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27095): Terminating (SIGTERM) 08:41:59.573975 --- ParallelTerminationStrategy: PID 27080 died... 08:41:59.593023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27080): Terminated: ok {rc=0} 08:41:59.636925 --- ParallelTerminationStrategy: PID 27081 died... 08:41:59.655905 run iperf3-srv_10.42.42.10(pid=27081): Terminated {rc=256} 08:41:59.699388 --- ParallelTerminationStrategy: PID 27083 died... 08:41:59.717995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27083): Terminated: ok {rc=0} 08:41:59.761463 --- ParallelTerminationStrategy: PID 27084 died... 08:41:59.779996 run iperf3-srv_10.42.42.10(pid=27084): Terminated {rc=256} 08:41:59.823572 --- ParallelTerminationStrategy: PID 27087 died... 08:41:59.842162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27087): Terminated: ok {rc=0} 08:41:59.885669 --- ParallelTerminationStrategy: PID 27090 died... 08:41:59.904829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27090): Terminated: ok {rc=0} 08:41:59.948405 --- ParallelTerminationStrategy: PID 27095 died... 08:41:59.967123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27095): Terminated: ok {rc=0} 08:42:00.052325 bus /gobi_0: Setting Powered False 08:42:01.154418 bus /gobi_0: Setting Powered False 08:42:02.286857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:42:03.437643 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:03.449585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:03.511573 tst iperf3.py: using LAC 32778 08:42:03.643605 tst iperf3.py: using RAC 138 08:42:03.770286 tst iperf3.py: using CellId 32778 08:42:03.896456 tst iperf3.py: using BVCI 32779 08:42:04.014392 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.025871 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.036862 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.047980 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.059709 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.071440 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.083238 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.094813 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:04.106652 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:04.223691 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:42:04.428802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:04.736206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27100): Launched 08:42:05.001407 run iperf3-srv_10.42.42.10(pid=27101): Launched 08:42:05.115298 tst iperf3.py:8: start network... 08:42:05.318377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:05.787499 run create_hlr_db(pid=27102): Launched 08:42:05.903268 bus /gobi_6: Setting Powered False 08:42:06.963617 run create_hlr_db(pid=27102): Terminated: ok {rc=0} 08:42:07.407074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27104): Launched 08:42:07.731286 run osmo-hlr_10.42.42.2(pid=27105): Launched 08:42:07.854758 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:08.412669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27107): Launched 08:42:08.737515 run osmo-stp_10.42.42.5(pid=27108): Launched 08:42:08.861106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:09.422438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27110): Launched 08:42:09.547370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:09.822054 run patchelf(pid=27111): Launched 08:42:10.001343 run osmo-stp_10.42.42.5(pid=27108): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27108)] 08:42:10.137648 run osmo-stp_10.42.42.5(pid=27108): stdout: | (launched: 2022-12-13_08:42:08.677105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:10.275833 run osmo-stp_10.42.42.5(pid=27108): stderr: | 20221213084208873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084208874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084208874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084208874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084208877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084208877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084208877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:10.414690 run osmo-stp_10.42.42.5(pid=27108): stdout: | (launched: 2022-12-13_08:42:08.677105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:10.547240 run osmo-stp_10.42.42.5(pid=27108): stderr: | 20221213084208873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084208874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084208874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084208874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084208877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084208877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084208877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:10.704897 run patchelf(pid=27111): Terminating (SIGINT) 08:42:10.885982 run patchelf(pid=27111): Terminated: ok {rc=0} 08:42:11.016512 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27108): Process ended prematurely: osmo-stp_10.42.42.5(pid=27108) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27108)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 08:42:11.026721 tst iperf3.py:8: Test FAILED (7.6 sec) 08:42:11.054863 run osmo-hlr_10.42.42.2(pid=27105): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27105)] 08:42:11.104434 run osmo-hlr_10.42.42.2(pid=27105): stdout: | (launched: 2022-12-13_08:42:07.671264) 08:42:11.156265 run osmo-hlr_10.42.42.2(pid=27105): stderr: | 20221213084207871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084207871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084207871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084207871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084207871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084207871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084207883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084207891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084207892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084207892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:11.208129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27100): Terminating (SIGTERM) 08:42:11.249606 run iperf3-srv_10.42.42.10(pid=27101): Terminating (SIGTERM) 08:42:11.291159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27104): Terminating (SIGTERM) 08:42:11.332731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27107): Terminating (SIGTERM) 08:42:11.374209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27110): Terminating (SIGTERM) 08:42:11.416195 --- ParallelTerminationStrategy: PID 27100 died... 08:42:11.436224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27100): Terminated: ok {rc=0} 08:42:11.482367 --- ParallelTerminationStrategy: PID 27101 died... 08:42:11.501666 run iperf3-srv_10.42.42.10(pid=27101): Terminated {rc=256} 08:42:11.547132 --- ParallelTerminationStrategy: PID 27104 died... 08:42:11.566504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27104): Terminated: ok {rc=0} 08:42:11.612150 --- ParallelTerminationStrategy: PID 27107 died... 08:42:11.631623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27107): Terminated: ok {rc=0} 08:42:11.677245 --- ParallelTerminationStrategy: PID 27110 died... 08:42:11.696596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27110): Terminated: ok {rc=0} 08:42:11.784798 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:42:12.936161 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:12.947979 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:13.005411 tst iperf3m4.py: using LAC 32779 08:42:13.131600 tst iperf3m4.py: using RAC 139 08:42:13.255578 tst iperf3m4.py: using CellId 32779 08:42:13.381980 tst iperf3m4.py: using BVCI 32780 08:42:13.492599 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.503599 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.514372 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.524898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.536394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.547963 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.559515 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.570918 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:13.582564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:13.706078 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:13.825873 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:13.945377 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:14.064408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:42:14.282323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:14.607908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27112): Launched 08:42:14.888657 run iperf3-srv_10.42.42.10(pid=27113): Launched 08:42:15.009172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:42:15.226237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:15.550898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Launched 08:42:15.831392 run iperf3-srv_10.42.42.10(pid=27115): Launched 08:42:15.954036 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:42:16.174984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:16.510803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Launched 08:42:16.811907 run iperf3-srv_10.42.42.10(pid=27117): Launched 08:42:16.986212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:42:17.195365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:17.505613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27118): Launched 08:42:17.768367 run iperf3-srv_10.42.42.10(pid=27119): Launched 08:42:17.881106 tst iperf3m4.py:8: start network... 08:42:18.082089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:18.549611 run create_hlr_db(pid=27120): Launched 08:42:18.664273 bus /gobi_6: Setting Powered False 08:42:19.727749 run create_hlr_db(pid=27120): Terminated: ok {rc=0} 08:42:20.158723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27122): Launched 08:42:20.462631 run osmo-hlr_10.42.42.2(pid=27123): Launched 08:42:20.577213 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:21.117685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27125): Launched 08:42:21.419007 run osmo-stp_10.42.42.5(pid=27126): Launched 08:42:21.533564 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:22.053993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27128): Launched 08:42:22.169294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:22.425416 run patchelf(pid=27129): Launched 08:42:22.592760 run osmo-stp_10.42.42.5(pid=27126): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27126)] 08:42:22.720828 run osmo-stp_10.42.42.5(pid=27126): stdout: | (launched: 2022-12-13_08:42:21.362613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:22.849895 run osmo-stp_10.42.42.5(pid=27126): stderr: | 20221213084221532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084221533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084221533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084221533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084221536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084221536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084221536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:23.004295 run osmo-stp_10.42.42.5(pid=27126): stdout: | (launched: 2022-12-13_08:42:21.362613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:23.125969 run osmo-stp_10.42.42.5(pid=27126): stderr: | 20221213084221532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084221533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084221533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084221533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084221536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084221536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084221536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:23.270315 run patchelf(pid=27129): Terminating (SIGINT) 08:42:23.437911 run patchelf(pid=27129): Terminated: ok {rc=0} 08:42:23.558335 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27126): Process ended prematurely: osmo-stp_10.42.42.5(pid=27126) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27126)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:42:23.567771 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:42:23.594705 run osmo-hlr_10.42.42.2(pid=27123): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27123)] 08:42:23.642179 run osmo-hlr_10.42.42.2(pid=27123): stdout: | (launched: 2022-12-13_08:42:20.404773) 08:42:23.691083 run osmo-hlr_10.42.42.2(pid=27123): stderr: | 20221213084220585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084220586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084220586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084220586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084220586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084220586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084220596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084220606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084220606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084220606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:23.740250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27112): Terminating (SIGTERM) 08:42:23.779714 run iperf3-srv_10.42.42.10(pid=27113): Terminating (SIGTERM) 08:42:23.819182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Terminating (SIGTERM) 08:42:23.858876 run iperf3-srv_10.42.42.10(pid=27115): Terminating (SIGTERM) 08:42:23.898294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Terminating (SIGTERM) 08:42:23.937669 run iperf3-srv_10.42.42.10(pid=27117): Terminating (SIGTERM) 08:42:23.976881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27118): Terminating (SIGTERM) 08:42:24.016306 run iperf3-srv_10.42.42.10(pid=27119): Terminating (SIGTERM) 08:42:24.055381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27122): Terminating (SIGTERM) 08:42:24.094787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27125): Terminating (SIGTERM) 08:42:24.134198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27128): Terminating (SIGTERM) 08:42:24.174032 --- ParallelTerminationStrategy: PID 27112 died... 08:42:24.193290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27112): Terminated: ok {rc=0} 08:42:24.237038 --- ParallelTerminationStrategy: PID 27113 died... 08:42:24.255665 run iperf3-srv_10.42.42.10(pid=27113): Terminated {rc=256} 08:42:24.299212 --- ParallelTerminationStrategy: PID 27114 died... 08:42:24.317970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Terminated: ok {rc=0} 08:42:24.361858 --- ParallelTerminationStrategy: PID 27115 died... 08:42:24.380477 run iperf3-srv_10.42.42.10(pid=27115): Terminated {rc=256} 08:42:24.424188 --- ParallelTerminationStrategy: PID 27116 died... 08:42:24.442930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27116): Terminated: ok {rc=0} 08:42:24.486666 --- ParallelTerminationStrategy: PID 27117 died... 08:42:24.505415 run iperf3-srv_10.42.42.10(pid=27117): Terminated {rc=256} 08:42:24.549284 --- ParallelTerminationStrategy: PID 27118 died... 08:42:24.568077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27118): Terminated: ok {rc=0} 08:42:24.611955 --- ParallelTerminationStrategy: PID 27119 died... 08:42:24.630751 run iperf3-srv_10.42.42.10(pid=27119): Terminated {rc=256} 08:42:24.674348 --- ParallelTerminationStrategy: PID 27122 died... 08:42:24.693374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27122): Terminated: ok {rc=0} 08:42:24.736827 --- ParallelTerminationStrategy: PID 27125 died... 08:42:24.755971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27125): Terminated: ok {rc=0} 08:42:24.799476 --- ParallelTerminationStrategy: PID 27128 died... 08:42:24.818086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27128): Terminated: ok {rc=0} 08:42:24.901229 bus /gobi_4: Setting Powered False 08:42:25.998776 bus /gobi_4: Setting Powered False 08:42:27.113643 bus /gobi_1: Setting Powered False 08:42:28.210083 bus /gobi_1: Setting Powered False 08:42:29.325535 bus /gobi_0: Setting Powered False 08:42:30.421497 bus /gobi_0: Setting Powered False 08:42:31.547081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:42:32.661522 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:32.673289 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:32.730167 tst ping.py: using LAC 32780 08:42:32.847656 tst ping.py: using RAC 140 08:42:32.961735 tst ping.py: using CellId 32780 08:42:33.074282 tst ping.py: using BVCI 32781 08:42:33.179642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:33.190630 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:33.201234 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:33.211770 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:33.222292 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:33.233865 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:33.245354 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:33.256138 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:33.375970 tst ping.py:19: start network... 08:42:33.586490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:34.068392 run create_hlr_db(pid=27130): Launched 08:42:34.195084 bus /gobi_6: Setting Powered False 08:42:35.258575 run create_hlr_db(pid=27130): Terminated: ok {rc=0} 08:42:35.675069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27132): Launched 08:42:35.965267 run osmo-hlr_10.42.42.2(pid=27133): Launched 08:42:36.075968 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:36.593061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27135): Launched 08:42:36.883076 run osmo-stp_10.42.42.5(pid=27136): Launched 08:42:36.993148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:37.494402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27138): Launched 08:42:37.604533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:37.848772 run patchelf(pid=27139): Launched 08:42:38.010630 run osmo-stp_10.42.42.5(pid=27136): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27136)] 08:42:38.134421 run osmo-stp_10.42.42.5(pid=27136): stdout: | (launched: 2022-12-13_08:42:36.830742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:38.259707 run osmo-stp_10.42.42.5(pid=27136): stderr: | 20221213084237000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084237000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084237000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084237001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084237001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084237001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084237001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:38.384662 run osmo-stp_10.42.42.5(pid=27136): stdout: | (launched: 2022-12-13_08:42:36.830742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:38.504662 run osmo-stp_10.42.42.5(pid=27136): stderr: | 20221213084237000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084237000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084237000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084237001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084237001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084237001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084237001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:38.646545 run patchelf(pid=27139): Terminating (SIGINT) 08:42:38.810916 run patchelf(pid=27139): Terminated: ok {rc=0} 08:42:38.928613 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27136): Process ended prematurely: osmo-stp_10.42.42.5(pid=27136) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27136)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 08:42:38.937584 tst ping.py:22: Test FAILED (6.3 sec) 08:42:38.964070 run osmo-hlr_10.42.42.2(pid=27133): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27133)] 08:42:39.012556 run osmo-hlr_10.42.42.2(pid=27133): stdout: | (launched: 2022-12-13_08:42:35.912894) 08:42:39.062037 run osmo-hlr_10.42.42.2(pid=27133): stderr: | 20221213084236086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084236086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084236086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084236086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084236086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084236086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084236102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084236112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084236113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084236113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:39.111758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27132): Terminating (SIGTERM) 08:42:39.151700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27135): Terminating (SIGTERM) 08:42:39.191398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27138): Terminating (SIGTERM) 08:42:39.231168 --- ParallelTerminationStrategy: PID 27132 died... 08:42:39.250596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27132): Terminated: ok {rc=0} 08:42:39.294622 --- ParallelTerminationStrategy: PID 27135 died... 08:42:39.313426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27135): Terminated: ok {rc=0} 08:42:39.357516 --- ParallelTerminationStrategy: PID 27138 died... 08:42:39.376319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27138): Terminated: ok {rc=0} 08:42:39.459617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:42:40.544385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:40.555830 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:40.614296 tst ping_idle_ping.py: using LAC 32781 08:42:40.730507 tst ping_idle_ping.py: using RAC 141 08:42:40.845649 tst ping_idle_ping.py: using CellId 32781 08:42:40.962289 tst ping_idle_ping.py: using BVCI 32782 08:42:41.068103 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:41.079193 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:41.089995 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:41.100746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:41.112344 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:41.123867 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:41.135655 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:41.147205 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:41.265615 tst ping_idle_ping.py:24: start network... 08:42:41.476826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:41.964737 run create_hlr_db(pid=27140): Launched 08:42:42.093054 bus /gobi_6: Setting Powered False 08:42:43.155315 run create_hlr_db(pid=27140): Terminated: ok {rc=0} 08:42:43.592770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27142): Launched 08:42:43.905513 run osmo-hlr_10.42.42.2(pid=27143): Launched 08:42:44.025378 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:44.564506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27145): Launched 08:42:44.877594 run osmo-stp_10.42.42.5(pid=27146): Launched 08:42:44.996863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:45.538542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27148): Launched 08:42:45.657890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:45.921468 run patchelf(pid=27149): Launched 08:42:46.112326 run osmo-stp_10.42.42.5(pid=27146): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27146)] 08:42:46.248450 run osmo-stp_10.42.42.5(pid=27146): stdout: | (launched: 2022-12-13_08:42:44.820772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:46.385706 run osmo-stp_10.42.42.5(pid=27146): stderr: | 20221213084245009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084245010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084245010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084245010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084245011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084245011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084245011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:46.523675 run osmo-stp_10.42.42.5(pid=27146): stdout: | (launched: 2022-12-13_08:42:44.820772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:46.655176 run osmo-stp_10.42.42.5(pid=27146): stderr: | 20221213084245009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084245010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084245010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084245010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084245011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084245011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084245011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:46.810785 run patchelf(pid=27149): Terminating (SIGINT) 08:42:46.993489 run patchelf(pid=27149): Terminated: ok {rc=0} 08:42:47.158851 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27146): Process ended prematurely: osmo-stp_10.42.42.5(pid=27146) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27146)] [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:42:47.173087 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:42:47.209680 run osmo-hlr_10.42.42.2(pid=27143): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27143)] 08:42:47.262190 run osmo-hlr_10.42.42.2(pid=27143): stdout: | (launched: 2022-12-13_08:42:43.849095) 08:42:47.314997 run osmo-hlr_10.42.42.2(pid=27143): stderr: | 20221213084244043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084244043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084244043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084244043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084244043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084244043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084244057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084244065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084244065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084244066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:47.365976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27142): Terminating (SIGTERM) 08:42:47.406576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27145): Terminating (SIGTERM) 08:42:47.447142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27148): Terminating (SIGTERM) 08:42:47.488008 --- ParallelTerminationStrategy: PID 27142 died... 08:42:47.508095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27142): Terminated: ok {rc=0} 08:42:47.553356 --- ParallelTerminationStrategy: PID 27145 died... 08:42:47.572924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27145): Terminated: ok {rc=0} 08:42:47.618027 --- ParallelTerminationStrategy: PID 27148 died... 08:42:47.637811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27148): Terminated: ok {rc=0} 08:42:47.725100 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:42:49.012078 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:49.018936 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:42:49.039697 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:42:49.075116 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:42:49.126790 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:42:49.147355 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:42:49.182231 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:42:49.739198 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:42:49.744507 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:49.755764 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:42:49.812679 tst switch_tch_pdch.py: using LAC 32782 08:42:49.929326 tst switch_tch_pdch.py: using RAC 142 08:42:50.043314 tst switch_tch_pdch.py: using CellId 32782 08:42:50.157378 tst switch_tch_pdch.py: using BVCI 32783 08:42:50.262930 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:50.274330 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:50.285563 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:50.296582 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:50.308026 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:50.319434 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:50.330916 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:42:50.342459 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:42:50.462985 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:42:50.580436 tst switch_tch_pdch.py:51: start network... 08:42:50.790683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:51.274848 run create_hlr_db(pid=27153): Launched 08:42:51.402157 bus /gobi_6: Setting Powered False 08:42:52.464645 run create_hlr_db(pid=27153): Terminated: ok {rc=0} 08:42:52.880573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27155): Launched 08:42:53.170802 run osmo-hlr_10.42.42.2(pid=27156): Launched 08:42:53.281520 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:53.780865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27158): Launched 08:42:54.070664 run osmo-stp_10.42.42.5(pid=27159): Launched 08:42:54.181405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:54.681474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27161): Launched 08:42:54.793323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:55.037829 run patchelf(pid=27162): Launched 08:42:55.199731 run osmo-stp_10.42.42.5(pid=27159): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27159)] 08:42:55.323874 run osmo-stp_10.42.42.5(pid=27159): stdout: | (launched: 2022-12-13_08:42:54.017842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:55.449247 run osmo-stp_10.42.42.5(pid=27159): stderr: | 20221213084254183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084254183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084254183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084254184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084254186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084254186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084254186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:55.574655 run osmo-stp_10.42.42.5(pid=27159): stdout: | (launched: 2022-12-13_08:42:54.017842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:55.694698 run osmo-stp_10.42.42.5(pid=27159): stderr: | 20221213084254183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084254183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084254183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084254184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084254186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084254186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084254186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:55.837161 run patchelf(pid=27162): Terminating (SIGINT) 08:42:56.001390 run patchelf(pid=27162): Terminated: ok {rc=0} 08:42:56.119949 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27159): Process ended prematurely: osmo-stp_10.42.42.5(pid=27159) [trial-2387↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27159)] [trial-2387↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:42:56.128735 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 08:42:56.155072 run osmo-hlr_10.42.42.2(pid=27156): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27156)] 08:42:56.203834 run osmo-hlr_10.42.42.2(pid=27156): stdout: | (launched: 2022-12-13_08:42:53.118490) 08:42:56.253306 run osmo-hlr_10.42.42.2(pid=27156): stderr: | 20221213084253291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084253291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084253292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084253292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084253292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084253292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084253304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084253314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084253314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084253315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:56.303153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27155): Terminating (SIGTERM) 08:42:56.343195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27158): Terminating (SIGTERM) 08:42:56.382996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27161): Terminating (SIGTERM) 08:42:56.423140 --- ParallelTerminationStrategy: PID 27155 died... 08:42:56.442853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27155): Terminated: ok {rc=0} 08:42:56.487057 --- ParallelTerminationStrategy: PID 27158 died... 08:42:56.506121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27158): Terminated: ok {rc=0} 08:42:56.550527 --- ParallelTerminationStrategy: PID 27161 died... 08:42:56.569696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27161): Terminated: ok {rc=0} 08:42:56.655828 bus /gobi_0: Setting Powered False 08:42:57.754305 bus /gobi_0: Setting Powered False 08:42:58.869969 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:43:00.110253 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:00.116915 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:43:00.137243 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:43:00.172147 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:43:00.224367 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:43:00.245474 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:43:00.279972 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:43:00.836518 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:43:00.842697 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:00.854091 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:43:00.912767 tst switch_tch_pdch.py: using LAC 32783 08:43:01.063083 tst switch_tch_pdch.py: using RAC 143 08:43:01.184301 tst switch_tch_pdch.py: using CellId 32783 08:43:01.311798 tst switch_tch_pdch.py: using BVCI 32784 08:43:01.430894 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:01.443554 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:01.457145 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:01.469652 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:01.482555 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:01.495332 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:01.508324 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:01.521433 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:43:01.644337 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:43:01.787876 tst switch_tch_pdch.py:51: start network... 08:43:02.005995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:02.473726 run create_hlr_db(pid=27166): Launched 08:43:02.600225 bus /gobi_6: Setting Powered False 08:43:03.661758 run create_hlr_db(pid=27166): Terminated: ok {rc=0} 08:43:04.053428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27168): Launched 08:43:04.343775 run osmo-hlr_10.42.42.2(pid=27169): Launched 08:43:04.454559 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:04.941304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27171): Launched 08:43:05.231058 run osmo-stp_10.42.42.5(pid=27172): Launched 08:43:05.341326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:05.817295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27174): Launched 08:43:05.929076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:06.174324 run patchelf(pid=27175): Launched 08:43:06.335968 run osmo-stp_10.42.42.5(pid=27172): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27172)] 08:43:06.459674 run osmo-stp_10.42.42.5(pid=27172): stdout: | (launched: 2022-12-13_08:43:05.178448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:06.584709 run osmo-stp_10.42.42.5(pid=27172): stderr: | 20221213084305348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084305348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084305348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084305348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084305349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084305349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084305349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:06.709901 run osmo-stp_10.42.42.5(pid=27172): stdout: | (launched: 2022-12-13_08:43:05.178448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:06.830542 run osmo-stp_10.42.42.5(pid=27172): stderr: | 20221213084305348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084305348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084305348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084305348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084305349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084305349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084305349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:06.983865 run patchelf(pid=27175): Terminating (SIGINT) 08:43:07.159907 run patchelf(pid=27175): Terminated: ok {rc=0} 08:43:07.286446 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27172): Process ended prematurely: osmo-stp_10.42.42.5(pid=27172) [trial-2387↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27172)] [trial-2387↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:43:07.296212 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 08:43:07.323938 run osmo-hlr_10.42.42.2(pid=27169): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27169)] 08:43:07.374169 run osmo-hlr_10.42.42.2(pid=27169): stdout: | (launched: 2022-12-13_08:43:04.291045) 08:43:07.426051 run osmo-hlr_10.42.42.2(pid=27169): stderr: | 20221213084304465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084304465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084304465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084304466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084304466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084304466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084304478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084304487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084304487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084304487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:07.478216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27168): Terminating (SIGTERM) 08:43:07.519686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27171): Terminating (SIGTERM) 08:43:07.561550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27174): Terminating (SIGTERM) 08:43:07.603449 --- ParallelTerminationStrategy: PID 27168 died... 08:43:07.622933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27168): Terminated: ok {rc=0} 08:43:07.668654 --- ParallelTerminationStrategy: PID 27171 died... 08:43:07.688330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27171): Terminated: ok {rc=0} 08:43:07.733928 --- ParallelTerminationStrategy: PID 27174 died... 08:43:07.753483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27174): Terminated: ok {rc=0} 08:43:07.841163 bus /gobi_0: Setting Powered False 08:43:08.938821 bus /gobi_0: Setting Powered False 08:43:10.053085 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_sms:oc2g --------------------------------------------------------------------- 08:43:11.290825 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:11.294807 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 08:43:11.315618 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 08:43:11.322516 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 08:43:11.374877 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 08:43:11.395653 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 08:43:11.402443 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 08:43:11.940701 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:43:11.946015 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 08:43:11.957066 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 08:43:11.991006 tst mo_mt_sms.py: using LAC 32784 08:43:12.107416 tst mo_mt_sms.py: using RAC 144 08:43:12.222368 tst mo_mt_sms.py: using CellId 32784 08:43:12.338969 tst mo_mt_sms.py: using BVCI 32785 08:43:12.444656 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:43:12.562438 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:43:12.676045 tst mo_mt_sms.py:9: start nitb and bts... 08:43:12.871831 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:43:13.468093 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27180): Launched 08:43:13.759285 run osmo-nitb_10.42.42.2(pid=27181): Launched 08:43:13.921264 run osmo-nitb_10.42.42.2(pid=27181): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27181)] 08:43:14.053084 run osmo-nitb_10.42.42.2(pid=27181): stdout: | (launched: 2022-12-13_08:43:13.706698) 08:43:14.186743 run osmo-nitb_10.42.42.2(pid=27181): stderr: | (launched: 2022-12-13_08:43:13.750170) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:14.320126 run osmo-nitb_10.42.42.2(pid=27181): stdout: | (launched: 2022-12-13_08:43:13.706698) 08:43:14.448272 run osmo-nitb_10.42.42.2(pid=27181): stderr: | (launched: 2022-12-13_08:43:13.750170) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27181): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27181) [trial-2387↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27181)] 08:43:14.869241 tst osmo-nitb_10.42.42.2(pid=27181): stdout: | (launched: 2022-12-13_08:43:13.706698) 08:43:14.988150 tst osmo-nitb_10.42.42.2(pid=27181): stderr: | (launched: 2022-12-13_08:43:13.750170) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:15.127751 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27181): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27181) [trial-2387↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27181)] [trial-2387↪nitb_sms:oc2g↪mo_mt_sms.py:11] 08:43:15.136203 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 08:43:15.142637 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27180): Terminating (SIGTERM) 08:43:15.351298 --- ParallelTerminationStrategy: PID 27180 died... 08:43:15.371908 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27180): Terminated: ok {rc=0} 08:43:15.458044 bus /sierra_3: Setting Powered False 08:43:16.557246 bus /sierra_3: Setting Powered False 08:43:17.672506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:oc2g --------------------------------------------------------------------- 08:43:18.853158 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:18.857146 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 08:43:18.877210 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 08:43:18.904348 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 08:43:18.955188 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 08:43:18.975198 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 08:43:19.001547 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 08:43:19.545937 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:43:19.550706 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:43:19.560940 tst sms:oc2g: Using 1 x bts (candidates: 1) 08:43:19.593982 tst mo_mt_sms.py: using LAC 32785 08:43:19.709489 tst mo_mt_sms.py: using RAC 145 08:43:19.835816 tst mo_mt_sms.py: using CellId 32785 08:43:19.958221 tst mo_mt_sms.py: using BVCI 32786 08:43:20.071767 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:43:20.082674 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:43:20.093636 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:43:20.104433 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:43:20.115178 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:43:20.125843 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:43:20.239751 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:43:20.356151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:20.841331 run create_hlr_db(pid=27185): Launched 08:43:20.967611 bus /sierra_2: Setting Powered False 08:43:22.029328 run create_hlr_db(pid=27185): Terminated: ok {rc=0} 08:43:22.444424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Launched 08:43:22.734421 run osmo-hlr_10.42.42.2(pid=27188): Launched 08:43:22.844595 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:23.383340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Launched 08:43:23.696276 run osmo-stp_10.42.42.5(pid=27191): Launched 08:43:23.816183 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:24.383064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27193): Launched 08:43:24.695620 run osmo-msc_10.42.42.6(pid=27194): Launched 08:43:24.869826 run osmo-stp_10.42.42.5(pid=27191): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] 08:43:25.001838 run osmo-stp_10.42.42.5(pid=27191): stdout: | (launched: 2022-12-13_08:43:23.639702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:25.134418 run osmo-stp_10.42.42.5(pid=27191): stderr: | 20221213084323828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084323828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084323828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084323829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084323831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084323831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084323831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:25.266860 run osmo-stp_10.42.42.5(pid=27191): stdout: | (launched: 2022-12-13_08:43:23.639702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:25.391649 run osmo-stp_10.42.42.5(pid=27191): stderr: | 20221213084323828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084323828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084323828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084323829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084323831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084323831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084323831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:25.541540 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27191): Process ended prematurely: osmo-stp_10.42.42.5(pid=27191) [trial-2387↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] [trial-2387↪sms:oc2g↪mo_mt_sms.py:16] 08:43:25.550518 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 08:43:25.577453 run osmo-hlr_10.42.42.2(pid=27188): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27188)] 08:43:25.626847 run osmo-hlr_10.42.42.2(pid=27188): stdout: | (launched: 2022-12-13_08:43:22.682082) 08:43:25.678179 run osmo-hlr_10.42.42.2(pid=27188): stderr: | 20221213084322852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084322852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084322853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084322853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084322853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084322853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084322867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084322876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084322876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084322876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:25.749686 run osmo-msc_10.42.42.6(pid=27194): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27194)] 08:43:25.799238 run osmo-msc_10.42.42.6(pid=27194): stdout: | (launched: 2022-12-13_08:43:24.639276) 08:43:25.850251 run osmo-msc_10.42.42.6(pid=27194): stderr: | 20221213084324962 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084324962 DLGLOBAL DEBUG validating counter group 0x7f4719338c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084324962 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084324962 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084324962 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084324962 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084324964 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084324964 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084324964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084324965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:25.901800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Terminating (SIGTERM) 08:43:25.943082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Terminating (SIGTERM) 08:43:25.984462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27193): Terminating (SIGTERM) 08:43:26.026844 --- ParallelTerminationStrategy: PID 27187 died... 08:43:26.047011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Terminated: ok {rc=0} 08:43:26.093344 --- ParallelTerminationStrategy: PID 27190 died... 08:43:26.112996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Terminated: ok {rc=0} 08:43:26.159905 --- ParallelTerminationStrategy: PID 27193 died... 08:43:26.179511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27193): Terminated: ok {rc=0} 08:43:26.267070 bus /sierra_3: Setting Powered False 08:43:27.365938 bus /sierra_3: Setting Powered False 08:43:28.480941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:oc2g --------------------------------------------------------------------- 08:43:29.695210 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:29.699099 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:43:29.719913 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 08:43:29.726923 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:43:29.760689 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:43:29.782243 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 08:43:29.789724 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:43:30.309820 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 08:43:30.315904 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 08:43:30.327578 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 08:43:30.360133 tst assert_extension.py: using LAC 32786 08:43:30.476594 tst assert_extension.py: using RAC 146 08:43:30.591890 tst assert_extension.py: using CellId 32786 08:43:30.707139 tst assert_extension.py: using BVCI 32787 08:43:30.813039 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 08:43:30.931162 tst assert_extension.py:10: start nitb and bts... 08:43:31.154353 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:43:31.811620 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27199): Launched 08:43:32.145704 run osmo-nitb_10.42.42.2(pid=27200): Launched 08:43:32.333637 run osmo-nitb_10.42.42.2(pid=27200): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27200)] 08:43:32.474775 run osmo-nitb_10.42.42.2(pid=27200): stdout: | (launched: 2022-12-13_08:43:32.076645) 08:43:32.617660 run osmo-nitb_10.42.42.2(pid=27200): stderr: | (launched: 2022-12-13_08:43:32.124105) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:32.760246 run osmo-nitb_10.42.42.2(pid=27200): stdout: | (launched: 2022-12-13_08:43:32.076645) 08:43:32.897285 run osmo-nitb_10.42.42.2(pid=27200): stderr: | (launched: 2022-12-13_08:43:32.124105) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27200) [trial-2387↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27200)] 08:43:33.277233 tst osmo-nitb_10.42.42.2(pid=27200): stdout: | (launched: 2022-12-13_08:43:32.076645) 08:43:33.403532 tst osmo-nitb_10.42.42.2(pid=27200): stderr: | (launched: 2022-12-13_08:43:32.124105) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:33.553224 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27200) [trial-2387↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27200)] [trial-2387↪nitb_ussd:oc2g↪assert_extension.py:12] 08:43:33.562308 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:43:33.569612 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27199): Terminating (SIGTERM) 08:43:33.780129 --- ParallelTerminationStrategy: PID 27199 died... 08:43:33.800117 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27199): Terminated: ok {rc=0} 08:43:33.889191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:oc2g --------------------------------------------------------------------- 08:43:35.053351 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:35.058223 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:43:35.078260 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 08:43:35.106392 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:43:35.141385 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:43:35.162683 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 08:43:35.189948 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:43:35.719616 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:oc2g assert_extension.py ---------------------------------------------- 08:43:35.724891 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:43:35.736190 tst ussd:oc2g: Using 1 x bts (candidates: 1) 08:43:35.770836 tst assert_extension.py: using LAC 32787 08:43:35.892154 tst assert_extension.py: using RAC 147 08:43:36.014747 tst assert_extension.py: using CellId 32787 08:43:36.143790 tst assert_extension.py: using BVCI 32788 08:43:36.251790 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:43:36.263368 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:43:36.273848 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:43:36.284136 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:43:36.294858 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:43:36.306041 tst ussd:oc2g: Using 1 x modem (candidates: 1) 08:43:36.423482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:36.907834 run create_hlr_db(pid=27204): Launched 08:43:37.035126 bus /sierra_2: Setting Powered False 08:43:38.097334 run create_hlr_db(pid=27204): Terminated: ok {rc=0} 08:43:38.513607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27206): Launched 08:43:38.826938 run osmo-hlr_10.42.42.2(pid=27207): Launched 08:43:38.946123 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:39.489193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27209): Launched 08:43:39.800908 run osmo-stp_10.42.42.5(pid=27210): Launched 08:43:39.920249 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:40.484851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27212): Launched 08:43:40.795918 run osmo-msc_10.42.42.6(pid=27213): Launched 08:43:40.969709 run osmo-stp_10.42.42.5(pid=27210): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27210)] 08:43:41.101483 run osmo-stp_10.42.42.5(pid=27210): stdout: | (launched: 2022-12-13_08:43:39.744566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:41.233572 run osmo-stp_10.42.42.5(pid=27210): stderr: | 20221213084339936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084339936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084339936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084339937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084339939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084339939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084339939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:41.365772 run osmo-stp_10.42.42.5(pid=27210): stdout: | (launched: 2022-12-13_08:43:39.744566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:41.491343 run osmo-stp_10.42.42.5(pid=27210): stderr: | 20221213084339936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084339936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084339936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084339937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084339939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084339939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084339939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:41.640745 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27210): Process ended prematurely: osmo-stp_10.42.42.5(pid=27210) [trial-2387↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27210)] [trial-2387↪ussd:oc2g↪assert_extension.py:17] 08:43:41.649848 tst assert_extension.py:17: Test FAILED (5.9 sec) 08:43:41.677097 run osmo-hlr_10.42.42.2(pid=27207): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27207)] 08:43:41.726942 run osmo-hlr_10.42.42.2(pid=27207): stdout: | (launched: 2022-12-13_08:43:38.770309) 08:43:41.778379 run osmo-hlr_10.42.42.2(pid=27207): stderr: | 20221213084338966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084338966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084338966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084338966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084338966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084338966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084338979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084338989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084338990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084338990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:41.850255 run osmo-msc_10.42.42.6(pid=27213): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27213)] 08:43:41.899970 run osmo-msc_10.42.42.6(pid=27213): stdout: | (launched: 2022-12-13_08:43:40.739633) 08:43:41.951271 run osmo-msc_10.42.42.6(pid=27213): stderr: | 20221213084341061 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084341062 DLGLOBAL DEBUG validating counter group 0x7fb5e991fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084341062 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084341062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084341062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084341062 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084341064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084341064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084341064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084341064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:42.003234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27206): Terminating (SIGTERM) 08:43:42.044591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27209): Terminating (SIGTERM) 08:43:42.085951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27212): Terminating (SIGTERM) 08:43:42.127874 --- ParallelTerminationStrategy: PID 27206 died... 08:43:42.147891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27206): Terminated: ok {rc=0} 08:43:42.194161 --- ParallelTerminationStrategy: PID 27209 died... 08:43:42.214066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27209): Terminated: ok {rc=0} 08:43:42.260236 --- ParallelTerminationStrategy: PID 27212 died... 08:43:42.280148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27212): Terminated: ok {rc=0} 08:43:42.367475 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:43:43.564402 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:43.571246 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:43:43.592180 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:43:43.620790 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:43:43.673705 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:43:43.694773 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:43:43.722633 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:43:44.270124 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:43:44.319866 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:44.330907 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:43:44.386371 tst mo_mt_call.py: using LAC 32788 08:43:44.504772 tst mo_mt_call.py: using RAC 148 08:43:44.621248 tst mo_mt_call.py: using CellId 32788 08:43:44.737252 tst mo_mt_call.py: using BVCI 32789 08:43:44.846474 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:44.857490 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:44.868179 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:44.878915 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:44.889997 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:44.901810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:43:45.022787 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:43:45.139436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:45.600172 run create_hlr_db(pid=27219): Launched 08:43:45.713610 bus /sierra_2: Setting Powered False 08:43:46.771715 run create_hlr_db(pid=27219): Terminated: ok {rc=0} 08:43:47.209634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27221): Launched 08:43:47.513487 run osmo-hlr_10.42.42.2(pid=27222): Launched 08:43:47.627861 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:48.153533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27224): Launched 08:43:48.472383 run osmo-stp_10.42.42.5(pid=27225): Launched 08:43:48.594862 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:49.168567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27227): Launched 08:43:49.486412 run osmo-msc_10.42.42.6(pid=27228): Launched 08:43:49.664576 run osmo-stp_10.42.42.5(pid=27225): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27225)] 08:43:49.798888 run osmo-stp_10.42.42.5(pid=27225): stdout: | (launched: 2022-12-13_08:43:48.414407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:49.935522 run osmo-stp_10.42.42.5(pid=27225): stderr: | 20221213084348607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084348607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084348607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084348607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084348608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084348608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084348608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:50.069816 run osmo-stp_10.42.42.5(pid=27225): stdout: | (launched: 2022-12-13_08:43:48.414407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:50.197073 run osmo-stp_10.42.42.5(pid=27225): stderr: | 20221213084348607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084348607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084348607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084348607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084348608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084348608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084348608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:50.349492 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27225): Process ended prematurely: osmo-stp_10.42.42.5(pid=27225) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27225)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:43:50.359177 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:43:50.386841 run osmo-hlr_10.42.42.2(pid=27222): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27222)] 08:43:50.436832 run osmo-hlr_10.42.42.2(pid=27222): stdout: | (launched: 2022-12-13_08:43:47.459383) 08:43:50.488904 run osmo-hlr_10.42.42.2(pid=27222): stderr: | 20221213084347636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084347636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084347636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084347636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084347636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084347636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084347651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084347661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084347661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084347661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:50.561010 run osmo-msc_10.42.42.6(pid=27228): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27228)] 08:43:50.610280 run osmo-msc_10.42.42.6(pid=27228): stdout: | (launched: 2022-12-13_08:43:49.428652) 08:43:50.661475 run osmo-msc_10.42.42.6(pid=27228): stderr: | 20221213084349753 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084349753 DLGLOBAL DEBUG validating counter group 0x7fd624b48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084349754 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084349754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084349754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084349754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084349756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084349756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084349756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084349756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:50.713077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27221): Terminating (SIGTERM) 08:43:50.754248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27224): Terminating (SIGTERM) 08:43:50.795773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27227): Terminating (SIGTERM) 08:43:50.837680 --- ParallelTerminationStrategy: PID 27221 died... 08:43:50.857851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27221): Terminated: ok {rc=0} 08:43:50.903930 --- ParallelTerminationStrategy: PID 27224 died... 08:43:50.923632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27224): Terminated: ok {rc=0} 08:43:50.969615 --- ParallelTerminationStrategy: PID 27227 died... 08:43:50.989360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27227): Terminated: ok {rc=0} 08:43:51.076419 bus /sierra_3: Setting Powered False 08:43:52.174265 bus /sierra_3: Setting Powered False 08:43:53.291411 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:43:54.435436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:54.447055 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:43:54.502876 tst mo_mt_call_osmux.py: using LAC 32789 08:43:54.621319 tst mo_mt_call_osmux.py: using RAC 149 08:43:54.737851 tst mo_mt_call_osmux.py: using CellId 32789 08:43:54.855697 tst mo_mt_call_osmux.py: using BVCI 32790 08:43:54.964344 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:54.975529 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:54.986530 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:54.997436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:55.008826 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:43:55.020285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:43:55.136472 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:43:55.255699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:55.749561 run create_hlr_db(pid=27230): Launched 08:43:55.878522 bus /sierra_2: Setting Powered False 08:43:56.942030 run create_hlr_db(pid=27230): Terminated: ok {rc=0} 08:43:57.364940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27232): Launched 08:43:57.661308 run osmo-hlr_10.42.42.2(pid=27233): Launched 08:43:57.774712 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:58.298508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27235): Launched 08:43:58.594263 run osmo-stp_10.42.42.5(pid=27236): Launched 08:43:58.707448 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:59.241232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27238): Launched 08:43:59.536909 run osmo-msc_10.42.42.6(pid=27239): Launched 08:43:59.703191 run osmo-stp_10.42.42.5(pid=27236): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27236)] 08:43:59.829528 run osmo-stp_10.42.42.5(pid=27236): stdout: | (launched: 2022-12-13_08:43:58.540732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:59.955683 run osmo-stp_10.42.42.5(pid=27236): stderr: | 20221213084358710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084358710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084358710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084358711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084358711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084358711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084358711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:00.079549 run osmo-stp_10.42.42.5(pid=27236): stdout: | (launched: 2022-12-13_08:43:58.540732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:00.198930 run osmo-stp_10.42.42.5(pid=27236): stderr: | 20221213084358710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084358710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084358710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084358711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084358711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084358711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084358711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:00.341123 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27236): Process ended prematurely: osmo-stp_10.42.42.5(pid=27236) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27236)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:44:00.350127 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:44:00.376240 run osmo-hlr_10.42.42.2(pid=27233): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27233)] 08:44:00.424782 run osmo-hlr_10.42.42.2(pid=27233): stdout: | (launched: 2022-12-13_08:43:57.607156) 08:44:00.474415 run osmo-hlr_10.42.42.2(pid=27233): stderr: | 20221213084357780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084357780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084357780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084357780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084357780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084357780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084357790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084357800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084357800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084357800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:00.543365 run osmo-msc_10.42.42.6(pid=27239): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27239)] 08:44:00.590590 run osmo-msc_10.42.42.6(pid=27239): stdout: | (launched: 2022-12-13_08:43:59.483489) 08:44:00.639602 run osmo-msc_10.42.42.6(pid=27239): stderr: | 20221213084359754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084359754 DLGLOBAL DEBUG validating counter group 0x7f371da1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084359754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084359754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084359755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084359755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084359756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084359757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084359757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084359757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:00.689153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27232): Terminating (SIGTERM) 08:44:00.728637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27235): Terminating (SIGTERM) 08:44:00.768362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27238): Terminating (SIGTERM) 08:44:00.808319 --- ParallelTerminationStrategy: PID 27232 died... 08:44:00.827731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27232): Terminated: ok {rc=0} 08:44:00.871743 --- ParallelTerminationStrategy: PID 27235 died... 08:44:00.890564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27235): Terminated: ok {rc=0} 08:44:00.935075 --- ParallelTerminationStrategy: PID 27238 died... 08:44:00.954612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27238): Terminated: ok {rc=0} 08:44:01.043027 bus /sierra_3: Setting Powered False 08:44:02.148013 bus /sierra_3: Setting Powered False 08:44:03.285826 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:44:04.515678 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:04.521930 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:44:04.541992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:44:04.569060 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:44:04.620550 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:44:04.642183 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:44:04.670165 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:44:05.216045 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:44:05.264934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:05.276060 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:44:05.331005 tst mo_mt_call.py: using LAC 32790 08:44:05.448876 tst mo_mt_call.py: using RAC 150 08:44:05.568764 tst mo_mt_call.py: using CellId 32790 08:44:05.684840 tst mo_mt_call.py: using BVCI 32791 08:44:05.791892 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:05.802927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:05.813704 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:05.824335 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:05.835362 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:05.846412 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:05.961419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:06.081376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:06.575816 run create_hlr_db(pid=27244): Launched 08:44:06.705612 bus /sierra_2: Setting Powered False 08:44:07.769529 run create_hlr_db(pid=27244): Terminated: ok {rc=0} 08:44:08.193389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27246): Launched 08:44:08.490070 run osmo-hlr_10.42.42.2(pid=27247): Launched 08:44:08.603886 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:09.125677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27249): Launched 08:44:09.421261 run osmo-stp_10.42.42.5(pid=27250): Launched 08:44:09.535635 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:10.072529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27252): Launched 08:44:10.369067 run osmo-msc_10.42.42.6(pid=27253): Launched 08:44:10.536218 run osmo-stp_10.42.42.5(pid=27250): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27250)] 08:44:10.664041 run osmo-stp_10.42.42.5(pid=27250): stdout: | (launched: 2022-12-13_08:44:09.367762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:10.790378 run osmo-stp_10.42.42.5(pid=27250): stderr: | 20221213084409535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084409536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084409536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084409536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084409539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084409539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084409539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:10.914447 run osmo-stp_10.42.42.5(pid=27250): stdout: | (launched: 2022-12-13_08:44:09.367762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:11.033375 run osmo-stp_10.42.42.5(pid=27250): stderr: | 20221213084409535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084409536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084409536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084409536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084409539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084409539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084409539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:11.175660 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27250): Process ended prematurely: osmo-stp_10.42.42.5(pid=27250) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27250)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:44:11.184757 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:44:11.211283 run osmo-hlr_10.42.42.2(pid=27247): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27247)] 08:44:11.260146 run osmo-hlr_10.42.42.2(pid=27247): stdout: | (launched: 2022-12-13_08:44:08.436251) 08:44:11.310189 run osmo-hlr_10.42.42.2(pid=27247): stderr: | 20221213084408611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084408611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084408611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084408611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084408611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084408611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084408627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084408637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084408637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084408638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:11.380388 run osmo-msc_10.42.42.6(pid=27253): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27253)] 08:44:11.428073 run osmo-msc_10.42.42.6(pid=27253): stdout: | (launched: 2022-12-13_08:44:10.315307) 08:44:11.478027 run osmo-msc_10.42.42.6(pid=27253): stderr: | 20221213084410586 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084410586 DLGLOBAL DEBUG validating counter group 0x7efce8d82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084410586 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084410586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084410586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084410587 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084410588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084410589 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084410589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084410589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:11.528434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27246): Terminating (SIGTERM) 08:44:11.569176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27249): Terminating (SIGTERM) 08:44:11.609468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27252): Terminating (SIGTERM) 08:44:11.649719 --- ParallelTerminationStrategy: PID 27246 died... 08:44:11.669126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27246): Terminated: ok {rc=0} 08:44:11.713312 --- ParallelTerminationStrategy: PID 27249 died... 08:44:11.732189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27249): Terminated: ok {rc=0} 08:44:11.777256 --- ParallelTerminationStrategy: PID 27252 died... 08:44:11.796197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27252): Terminated: ok {rc=0} 08:44:11.883247 bus /sierra_3: Setting Powered False 08:44:12.981077 bus /sierra_3: Setting Powered False 08:44:14.095466 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:44:15.239983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:15.251677 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:44:15.308453 tst mo_mt_call_osmux.py: using LAC 32791 08:44:15.429839 tst mo_mt_call_osmux.py: using RAC 151 08:44:15.546474 tst mo_mt_call_osmux.py: using CellId 32791 08:44:15.663684 tst mo_mt_call_osmux.py: using BVCI 32792 08:44:15.771927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:15.783108 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:15.794044 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:15.804631 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:15.816516 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:15.827866 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:15.950577 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:16.094986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:16.610940 run create_hlr_db(pid=27255): Launched 08:44:16.765431 bus /sierra_2: Setting Powered False 08:44:17.829082 run create_hlr_db(pid=27255): Terminated: ok {rc=0} 08:44:18.262311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27257): Launched 08:44:18.559060 run osmo-hlr_10.42.42.2(pid=27258): Launched 08:44:18.672647 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:19.182689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27260): Launched 08:44:19.479130 run osmo-stp_10.42.42.5(pid=27261): Launched 08:44:19.592744 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:20.130075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27263): Launched 08:44:20.426210 run osmo-msc_10.42.42.6(pid=27264): Launched 08:44:20.592935 run osmo-stp_10.42.42.5(pid=27261): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27261)] 08:44:20.720059 run osmo-stp_10.42.42.5(pid=27261): stdout: | (launched: 2022-12-13_08:44:19.425297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:20.846184 run osmo-stp_10.42.42.5(pid=27261): stderr: | 20221213084419592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084419592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084419592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084419593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084419593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084419593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084419593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:20.970396 run osmo-stp_10.42.42.5(pid=27261): stdout: | (launched: 2022-12-13_08:44:19.425297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:21.089177 run osmo-stp_10.42.42.5(pid=27261): stderr: | 20221213084419592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084419592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084419592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084419593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084419593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084419593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084419593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:21.230660 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27261): Process ended prematurely: osmo-stp_10.42.42.5(pid=27261) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27261)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:44:21.239625 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:44:21.265997 run osmo-hlr_10.42.42.2(pid=27258): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27258)] 08:44:21.314625 run osmo-hlr_10.42.42.2(pid=27258): stdout: | (launched: 2022-12-13_08:44:18.505220) 08:44:21.364397 run osmo-hlr_10.42.42.2(pid=27258): stderr: | 20221213084418680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084418680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084418680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084418680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084418680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084418680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084418737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084418747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084418747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084418747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:21.434011 run osmo-msc_10.42.42.6(pid=27264): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27264)] 08:44:21.481416 run osmo-msc_10.42.42.6(pid=27264): stdout: | (launched: 2022-12-13_08:44:20.372666) 08:44:21.530847 run osmo-msc_10.42.42.6(pid=27264): stderr: | 20221213084420642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084420642 DLGLOBAL DEBUG validating counter group 0x7fc14151fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084420642 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084420642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084420642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084420643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084420644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084420645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084420645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084420645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:21.580639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27257): Terminating (SIGTERM) 08:44:21.621186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27260): Terminating (SIGTERM) 08:44:21.661220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27263): Terminating (SIGTERM) 08:44:21.701327 --- ParallelTerminationStrategy: PID 27257 died... 08:44:21.721079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27257): Terminated: ok {rc=0} 08:44:21.765407 --- ParallelTerminationStrategy: PID 27260 died... 08:44:21.784369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27260): Terminated: ok {rc=0} 08:44:21.828668 --- ParallelTerminationStrategy: PID 27263 died... 08:44:21.847942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27263): Terminated: ok {rc=0} 08:44:21.931524 bus /sierra_3: Setting Powered False 08:44:23.027795 bus /sierra_3: Setting Powered False 08:44:24.141968 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:44:25.377341 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:25.384291 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:44:25.405325 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:44:25.432893 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:44:25.486591 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:44:25.508207 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:44:25.534806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:44:26.084501 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:44:26.135407 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:26.146483 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:44:26.202579 tst mo_mt_call.py: using LAC 32792 08:44:26.320724 tst mo_mt_call.py: using RAC 152 08:44:26.440331 tst mo_mt_call.py: using CellId 32792 08:44:26.567970 tst mo_mt_call.py: using BVCI 32793 08:44:26.683747 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:26.695553 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:26.706927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:26.718273 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:26.729737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:26.740842 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:26.857368 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:26.976234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:27.469271 run create_hlr_db(pid=27269): Launched 08:44:27.598422 bus /sierra_2: Setting Powered False 08:44:28.661688 run create_hlr_db(pid=27269): Terminated: ok {rc=0} 08:44:29.102746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27271): Launched 08:44:29.419635 run osmo-hlr_10.42.42.2(pid=27272): Launched 08:44:29.540861 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:30.095438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27274): Launched 08:44:30.411623 run osmo-stp_10.42.42.5(pid=27275): Launched 08:44:30.532693 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:31.129012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27277): Launched 08:44:31.507131 run osmo-msc_10.42.42.6(pid=27278): Launched 08:44:31.922041 run osmo-stp_10.42.42.5(pid=27275): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27275)] 08:44:32.218340 run osmo-stp_10.42.42.5(pid=27275): stdout: | (launched: 2022-12-13_08:44:30.354545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:32.392288 run osmo-stp_10.42.42.5(pid=27275): stderr: | 20221213084430545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084430546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084430546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084430546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084430547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084430547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084430547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:32.551092 run osmo-stp_10.42.42.5(pid=27275): stdout: | (launched: 2022-12-13_08:44:30.354545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:32.679160 run osmo-stp_10.42.42.5(pid=27275): stderr: | 20221213084430545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084430546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084430546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084430546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084430547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084430547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084430547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:32.832411 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27275): Process ended prematurely: osmo-stp_10.42.42.5(pid=27275) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27275)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:44:32.842185 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 08:44:32.869907 run osmo-hlr_10.42.42.2(pid=27272): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27272)] 08:44:32.921236 run osmo-hlr_10.42.42.2(pid=27272): stdout: | (launched: 2022-12-13_08:44:29.362619) 08:44:32.973266 run osmo-hlr_10.42.42.2(pid=27272): stderr: | 20221213084429561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084429561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084429561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084429561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084429561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084429561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084429574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084429583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084429583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084429583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:33.046152 run osmo-msc_10.42.42.6(pid=27278): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27278)] 08:44:33.096092 run osmo-msc_10.42.42.6(pid=27278): stdout: | (launched: 2022-12-13_08:44:31.440483) 08:44:33.148153 run osmo-msc_10.42.42.6(pid=27278): stderr: | 20221213084431917 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084431917 DLGLOBAL DEBUG validating counter group 0x7f3795009c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084431918 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084431918 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084431918 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084431919 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084431921 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084431922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084431922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084431922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:33.200599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27271): Terminating (SIGTERM) 08:44:33.242647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27274): Terminating (SIGTERM) 08:44:33.284783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27277): Terminating (SIGTERM) 08:44:33.327419 --- ParallelTerminationStrategy: PID 27271 died... 08:44:33.348059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27271): Terminated: ok {rc=0} 08:44:33.394933 --- ParallelTerminationStrategy: PID 27274 died... 08:44:33.415272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27274): Terminated: ok {rc=0} 08:44:33.461828 --- ParallelTerminationStrategy: PID 27277 died... 08:44:33.481706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27277): Terminated: ok {rc=0} 08:44:33.569633 bus /sierra_3: Setting Powered False 08:44:34.667044 bus /sierra_3: Setting Powered False 08:44:35.780694 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:44:36.927070 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:36.939168 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:44:36.997481 tst mo_mt_call_osmux.py: using LAC 32793 08:44:37.123720 tst mo_mt_call_osmux.py: using RAC 153 08:44:37.248486 tst mo_mt_call_osmux.py: using CellId 32793 08:44:37.373158 tst mo_mt_call_osmux.py: using BVCI 32794 08:44:37.490718 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:37.502513 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:37.514169 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:37.525649 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:37.537332 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:37.548868 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:37.667756 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:37.786616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:38.279943 run create_hlr_db(pid=27280): Launched 08:44:38.409400 bus /sierra_2: Setting Powered False 08:44:39.472711 run create_hlr_db(pid=27280): Terminated: ok {rc=0} 08:44:39.897168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Launched 08:44:40.193341 run osmo-hlr_10.42.42.2(pid=27283): Launched 08:44:40.306765 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:40.833742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Launched 08:44:41.128939 run osmo-stp_10.42.42.5(pid=27286): Launched 08:44:41.242526 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:41.778517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Launched 08:44:42.075171 run osmo-msc_10.42.42.6(pid=27289): Launched 08:44:42.241207 run osmo-stp_10.42.42.5(pid=27286): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] 08:44:42.367057 run osmo-stp_10.42.42.5(pid=27286): stdout: | (launched: 2022-12-13_08:44:41.075169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:42.492697 run osmo-stp_10.42.42.5(pid=27286): stderr: | 20221213084441243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084441243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084441244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084441244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084441246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084441247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084441247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:42.616485 run osmo-stp_10.42.42.5(pid=27286): stdout: | (launched: 2022-12-13_08:44:41.075169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:42.734651 run osmo-stp_10.42.42.5(pid=27286): stderr: | 20221213084441243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084441243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084441244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084441244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084441246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084441247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084441247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:42.876508 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27286): Process ended prematurely: osmo-stp_10.42.42.5(pid=27286) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:44:42.885250 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:44:42.911457 run osmo-hlr_10.42.42.2(pid=27283): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27283)] 08:44:42.964853 run osmo-hlr_10.42.42.2(pid=27283): stdout: | (launched: 2022-12-13_08:44:40.139731) 08:44:43.016301 run osmo-hlr_10.42.42.2(pid=27283): stderr: | 20221213084440313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084440313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084440313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084440313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084440313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084440313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084440326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084440334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084440335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084440335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:43.088484 run osmo-msc_10.42.42.6(pid=27289): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27289)] 08:44:43.138381 run osmo-msc_10.42.42.6(pid=27289): stdout: | (launched: 2022-12-13_08:44:42.021171) 08:44:43.190243 run osmo-msc_10.42.42.6(pid=27289): stderr: | 20221213084442293 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084442293 DLGLOBAL DEBUG validating counter group 0x7fb714288c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084442293 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084442293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084442294 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084442294 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084442297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084442298 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084442298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084442298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:43.242322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Terminating (SIGTERM) 08:44:43.284012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Terminating (SIGTERM) 08:44:43.325749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Terminating (SIGTERM) 08:44:43.367702 --- ParallelTerminationStrategy: PID 27282 died... 08:44:43.387653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27282): Terminated: ok {rc=0} 08:44:43.433405 --- ParallelTerminationStrategy: PID 27285 died... 08:44:43.453020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27285): Terminated: ok {rc=0} 08:44:43.499243 --- ParallelTerminationStrategy: PID 27288 died... 08:44:43.518903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27288): Terminated: ok {rc=0} 08:44:43.606204 bus /sierra_3: Setting Powered False 08:44:44.703465 bus /sierra_3: Setting Powered False 08:44:45.821480 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:44:47.069493 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:47.076898 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:44:47.098579 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:44:47.129495 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:44:47.187876 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:44:47.222115 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:44:47.253472 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:44:47.782469 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:44:47.836759 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:47.848302 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:44:47.906968 tst mo_mt_call.py: using LAC 32794 08:44:48.032809 tst mo_mt_call.py: using RAC 154 08:44:48.159704 tst mo_mt_call.py: using CellId 32794 08:44:48.285193 tst mo_mt_call.py: using BVCI 32795 08:44:48.401280 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:48.412918 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:48.424367 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:48.435795 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:48.447571 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:48.459462 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:44:48.577730 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:44:48.700364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:49.194920 run create_hlr_db(pid=27294): Launched 08:44:49.324794 bus /sierra_2: Setting Powered False 08:44:50.388153 run create_hlr_db(pid=27294): Terminated: ok {rc=0} 08:44:50.832081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Launched 08:44:51.151058 run osmo-hlr_10.42.42.2(pid=27297): Launched 08:44:51.273245 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:51.820754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27299): Launched 08:44:52.138561 run osmo-stp_10.42.42.5(pid=27300): Launched 08:44:52.259299 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:52.835046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27302): Launched 08:44:53.153517 run osmo-msc_10.42.42.6(pid=27303): Launched 08:44:53.332372 run osmo-stp_10.42.42.5(pid=27300): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27300)] 08:44:53.466800 run osmo-stp_10.42.42.5(pid=27300): stdout: | (launched: 2022-12-13_08:44:52.081224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:53.602413 run osmo-stp_10.42.42.5(pid=27300): stderr: | 20221213084452272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084452272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084452273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084452273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084452274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084452274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084452274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:53.736384 run osmo-stp_10.42.42.5(pid=27300): stdout: | (launched: 2022-12-13_08:44:52.081224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:53.863696 run osmo-stp_10.42.42.5(pid=27300): stderr: | 20221213084452272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084452272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084452273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084452273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084452274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084452274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084452274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:54.016511 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27300): Process ended prematurely: osmo-stp_10.42.42.5(pid=27300) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27300)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:44:54.026248 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:44:54.053830 run osmo-hlr_10.42.42.2(pid=27297): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27297)] 08:44:54.104293 run osmo-hlr_10.42.42.2(pid=27297): stdout: | (launched: 2022-12-13_08:44:51.093814) 08:44:54.156253 run osmo-hlr_10.42.42.2(pid=27297): stderr: | 20221213084451289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084451289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084451290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084451290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084451290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084451290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084451302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084451312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084451313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084451313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:54.228636 run osmo-msc_10.42.42.6(pid=27303): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27303)] 08:44:54.278926 run osmo-msc_10.42.42.6(pid=27303): stdout: | (launched: 2022-12-13_08:44:53.095827) 08:44:54.330722 run osmo-msc_10.42.42.6(pid=27303): stderr: | 20221213084453418 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084453418 DLGLOBAL DEBUG validating counter group 0x7f82c5583c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084453418 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084453418 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084453418 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084453419 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084453420 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084453421 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084453421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084453421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:54.382937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Terminating (SIGTERM) 08:44:54.424623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27299): Terminating (SIGTERM) 08:44:54.466208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27302): Terminating (SIGTERM) 08:44:54.508534 --- ParallelTerminationStrategy: PID 27296 died... 08:44:54.528902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27296): Terminated: ok {rc=0} 08:44:54.575101 --- ParallelTerminationStrategy: PID 27299 died... 08:44:54.594752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27299): Terminated: ok {rc=0} 08:44:54.640704 --- ParallelTerminationStrategy: PID 27302 died... 08:44:54.660238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27302): Terminated: ok {rc=0} 08:44:54.747494 bus /sierra_3: Setting Powered False 08:44:55.844912 bus /sierra_3: Setting Powered False 08:44:56.961126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:44:58.109446 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:58.121502 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:44:58.179406 tst mo_mt_call_osmux.py: using LAC 32795 08:44:58.305340 tst mo_mt_call_osmux.py: using RAC 155 08:44:58.431123 tst mo_mt_call_osmux.py: using CellId 32795 08:44:58.558730 tst mo_mt_call_osmux.py: using BVCI 32796 08:44:58.675514 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:58.687074 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:58.698341 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:58.709766 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:58.721028 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:44:58.732304 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:44:58.852361 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:44:58.968906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:59.430342 run create_hlr_db(pid=27305): Launched 08:44:59.544449 bus /sierra_2: Setting Powered False 08:45:00.604860 run create_hlr_db(pid=27305): Terminated: ok {rc=0} 08:45:01.041962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27307): Launched 08:45:01.399933 run osmo-hlr_10.42.42.2(pid=27311): Launched 08:45:01.637294 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:02.288336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Launched 08:45:02.618386 run osmo-stp_10.42.42.5(pid=27314): Launched 08:45:02.741998 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:03.319639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27316): Launched 08:45:03.638372 run osmo-msc_10.42.42.6(pid=27317): Launched 08:45:03.815815 run osmo-stp_10.42.42.5(pid=27314): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27314)] 08:45:03.951317 run osmo-stp_10.42.42.5(pid=27314): stdout: | (launched: 2022-12-13_08:45:02.560935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:04.086273 run osmo-stp_10.42.42.5(pid=27314): stderr: | 20221213084502751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084502752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084502752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084502752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084502753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084502753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084502753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:04.220202 run osmo-stp_10.42.42.5(pid=27314): stdout: | (launched: 2022-12-13_08:45:02.560935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:04.347464 run osmo-stp_10.42.42.5(pid=27314): stderr: | 20221213084502751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084502752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084502752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084502752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084502753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084502753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084502753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:04.499916 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27314): Process ended prematurely: osmo-stp_10.42.42.5(pid=27314) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27314)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:45:04.509701 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:45:04.537514 run osmo-hlr_10.42.42.2(pid=27311): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27311)] 08:45:04.587407 run osmo-hlr_10.42.42.2(pid=27311): stdout: | (launched: 2022-12-13_08:45:01.322074) 08:45:04.638796 run osmo-hlr_10.42.42.2(pid=27311): stderr: | 20221213084501522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084501523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084501523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084501523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084501523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084501523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084501547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084501560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084501561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084501561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:04.710394 run osmo-msc_10.42.42.6(pid=27317): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27317)] 08:45:04.759861 run osmo-msc_10.42.42.6(pid=27317): stdout: | (launched: 2022-12-13_08:45:03.581094) 08:45:04.811062 run osmo-msc_10.42.42.6(pid=27317): stderr: | 20221213084503905 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084503905 DLGLOBAL DEBUG validating counter group 0x7fb47179dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084503905 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084503906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084503906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084503906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084503907 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084503908 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084503908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084503908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:04.862567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27307): Terminating (SIGTERM) 08:45:04.903861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Terminating (SIGTERM) 08:45:04.945007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27316): Terminating (SIGTERM) 08:45:04.987134 --- ParallelTerminationStrategy: PID 27307 died... 08:45:05.007141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27307): Terminated: ok {rc=0} 08:45:05.052827 --- ParallelTerminationStrategy: PID 27313 died... 08:45:05.072539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Terminated: ok {rc=0} 08:45:05.118197 --- ParallelTerminationStrategy: PID 27316 died... 08:45:05.137537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27316): Terminated: ok {rc=0} 08:45:05.224688 bus /sierra_3: Setting Powered False 08:45:06.322283 bus /sierra_3: Setting Powered False 08:45:07.436879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:45:08.664618 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:08.672385 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:45:08.693307 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:45:08.720564 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:45:08.772848 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:45:08.793848 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:45:08.821428 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:45:09.368522 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:45:09.416917 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:09.427991 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:45:09.484356 tst mo_mt_call.py: using LAC 32796 08:45:09.603550 tst mo_mt_call.py: using RAC 156 08:45:09.723607 tst mo_mt_call.py: using CellId 32796 08:45:09.849738 tst mo_mt_call.py: using BVCI 32797 08:45:09.965548 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:09.977207 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:09.988608 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:10.000278 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:10.011639 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:10.022978 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:10.141940 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:10.262349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:10.757026 run create_hlr_db(pid=27322): Launched 08:45:10.886903 bus /sierra_2: Setting Powered False 08:45:11.950908 run create_hlr_db(pid=27322): Terminated: ok {rc=0} 08:45:12.393902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27324): Launched 08:45:12.712328 run osmo-hlr_10.42.42.2(pid=27325): Launched 08:45:12.833738 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:13.381495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27327): Launched 08:45:13.701563 run osmo-stp_10.42.42.5(pid=27328): Launched 08:45:13.823457 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:14.401514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27330): Launched 08:45:14.720214 run osmo-msc_10.42.42.6(pid=27331): Launched 08:45:14.898409 run osmo-stp_10.42.42.5(pid=27328): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27328)] 08:45:15.033054 run osmo-stp_10.42.42.5(pid=27328): stdout: | (launched: 2022-12-13_08:45:13.643595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:15.167684 run osmo-stp_10.42.42.5(pid=27328): stderr: | 20221213084513834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084513834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084513834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084513834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084513837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084513837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084513837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:15.302678 run osmo-stp_10.42.42.5(pid=27328): stdout: | (launched: 2022-12-13_08:45:13.643595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:15.430374 run osmo-stp_10.42.42.5(pid=27328): stderr: | 20221213084513834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084513834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084513834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084513834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084513837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084513837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084513837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:15.583483 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27328): Process ended prematurely: osmo-stp_10.42.42.5(pid=27328) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27328)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:45:15.593292 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:45:15.621200 run osmo-hlr_10.42.42.2(pid=27325): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27325)] 08:45:15.671791 run osmo-hlr_10.42.42.2(pid=27325): stdout: | (launched: 2022-12-13_08:45:12.654968) 08:45:15.723656 run osmo-hlr_10.42.42.2(pid=27325): stderr: | 20221213084512851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084512851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084512851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084512851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084512851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084512851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084512865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084512873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084512874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084512874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:15.796208 run osmo-msc_10.42.42.6(pid=27331): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27331)] 08:45:15.846560 run osmo-msc_10.42.42.6(pid=27331): stdout: | (launched: 2022-12-13_08:45:14.662410) 08:45:15.898592 run osmo-msc_10.42.42.6(pid=27331): stderr: | 20221213084514986 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084514986 DLGLOBAL DEBUG validating counter group 0x7f033605cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084514986 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084514986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084514986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084514986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084514988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084514989 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084514989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084514989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:15.950874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27324): Terminating (SIGTERM) 08:45:15.993597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27327): Terminating (SIGTERM) 08:45:16.036388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27330): Terminating (SIGTERM) 08:45:16.079564 --- ParallelTerminationStrategy: PID 27324 died... 08:45:16.100106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27324): Terminated: ok {rc=0} 08:45:16.147220 --- ParallelTerminationStrategy: PID 27327 died... 08:45:16.167622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27327): Terminated: ok {rc=0} 08:45:16.214796 --- ParallelTerminationStrategy: PID 27330 died... 08:45:16.235324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27330): Terminated: ok {rc=0} 08:45:16.329534 bus /sierra_3: Setting Powered False 08:45:17.440123 bus /sierra_3: Setting Powered False 08:45:18.555743 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:45:19.704241 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:19.716399 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:45:19.775208 tst mo_mt_call_osmux.py: using LAC 32797 08:45:19.901657 tst mo_mt_call_osmux.py: using RAC 157 08:45:20.028390 tst mo_mt_call_osmux.py: using CellId 32797 08:45:20.154265 tst mo_mt_call_osmux.py: using BVCI 32798 08:45:20.269830 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:20.281414 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:20.292591 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:20.303818 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:20.315316 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:20.326838 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:20.446090 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:20.562235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:21.024201 run create_hlr_db(pid=27333): Launched 08:45:21.139179 bus /sierra_2: Setting Powered False 08:45:22.199043 run create_hlr_db(pid=27333): Terminated: ok {rc=0} 08:45:22.634240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27335): Launched 08:45:22.951316 run osmo-hlr_10.42.42.2(pid=27336): Launched 08:45:23.072855 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:23.620606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27338): Launched 08:45:23.939937 run osmo-stp_10.42.42.5(pid=27339): Launched 08:45:24.061954 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:24.638812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27341): Launched 08:45:24.956531 run osmo-msc_10.42.42.6(pid=27342): Launched 08:45:25.134864 run osmo-stp_10.42.42.5(pid=27339): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27339)] 08:45:25.269702 run osmo-stp_10.42.42.5(pid=27339): stdout: | (launched: 2022-12-13_08:45:23.881525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:25.405109 run osmo-stp_10.42.42.5(pid=27339): stderr: | 20221213084524074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084524074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084524074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084524075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084524075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084524075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084524075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:25.541095 run osmo-stp_10.42.42.5(pid=27339): stdout: | (launched: 2022-12-13_08:45:23.881525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:25.668675 run osmo-stp_10.42.42.5(pid=27339): stderr: | 20221213084524074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084524074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084524074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084524075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084524075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084524075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084524075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:25.821244 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27339): Process ended prematurely: osmo-stp_10.42.42.5(pid=27339) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27339)] [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:45:25.831016 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:45:25.859180 run osmo-hlr_10.42.42.2(pid=27336): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27336)] 08:45:25.909921 run osmo-hlr_10.42.42.2(pid=27336): stdout: | (launched: 2022-12-13_08:45:22.894114) 08:45:25.961991 run osmo-hlr_10.42.42.2(pid=27336): stderr: | 20221213084523091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084523091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084523091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084523091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084523091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084523091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084523103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084523112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084523112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084523112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:26.035019 run osmo-msc_10.42.42.6(pid=27342): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27342)] 08:45:26.085360 run osmo-msc_10.42.42.6(pid=27342): stdout: | (launched: 2022-12-13_08:45:24.899155) 08:45:26.137407 run osmo-msc_10.42.42.6(pid=27342): stderr: | 20221213084525220 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084525221 DLGLOBAL DEBUG validating counter group 0x7f398e20cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084525221 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084525221 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084525221 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084525221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084525223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084525223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084525223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084525224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:26.189692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27335): Terminating (SIGTERM) 08:45:26.231331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27338): Terminating (SIGTERM) 08:45:26.273099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27341): Terminating (SIGTERM) 08:45:26.315004 --- ParallelTerminationStrategy: PID 27335 died... 08:45:26.334774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27335): Terminated: ok {rc=0} 08:45:26.381120 --- ParallelTerminationStrategy: PID 27338 died... 08:45:26.400893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27338): Terminated: ok {rc=0} 08:45:26.447388 --- ParallelTerminationStrategy: PID 27341 died... 08:45:26.467277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27341): Terminated: ok {rc=0} 08:45:26.555322 bus /sierra_3: Setting Powered False 08:45:27.652783 bus /sierra_3: Setting Powered False 08:45:28.766072 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:45:30.006757 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:30.013603 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:45:30.034369 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:45:30.061752 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:45:30.112721 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:45:30.133163 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:45:30.159674 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:45:30.710928 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:45:30.759123 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:30.770534 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:45:30.830843 tst mo_mt_call.py: using LAC 32798 08:45:30.959904 tst mo_mt_call.py: using RAC 158 08:45:31.087528 tst mo_mt_call.py: using CellId 32798 08:45:31.227038 tst mo_mt_call.py: using BVCI 32799 08:45:31.392042 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:31.406776 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:31.421375 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:31.437648 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:31.451399 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:31.468095 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:45:31.620697 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:45:31.742868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:32.256479 run create_hlr_db(pid=27348): Launched 08:45:32.419336 bus /sierra_2: Setting Powered False 08:45:33.482225 run create_hlr_db(pid=27348): Terminated: ok {rc=0} 08:45:33.907246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27350): Launched 08:45:34.203529 run osmo-hlr_10.42.42.2(pid=27351): Launched 08:45:34.315331 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:34.840127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27353): Launched 08:45:35.136513 run osmo-stp_10.42.42.5(pid=27354): Launched 08:45:35.250344 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:35.788365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27356): Launched 08:45:36.085534 run osmo-msc_10.42.42.6(pid=27357): Launched 08:45:36.253547 run osmo-stp_10.42.42.5(pid=27354): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27354)] 08:45:36.380332 run osmo-stp_10.42.42.5(pid=27354): stdout: | (launched: 2022-12-13_08:45:35.082552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:36.506544 run osmo-stp_10.42.42.5(pid=27354): stderr: | 20221213084535250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084535250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084535250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084535250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084535253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084535253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084535253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:36.630738 run osmo-stp_10.42.42.5(pid=27354): stdout: | (launched: 2022-12-13_08:45:35.082552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:36.750117 run osmo-stp_10.42.42.5(pid=27354): stderr: | 20221213084535250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084535250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084535250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084535250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084535253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084535253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084535253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:36.892168 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27354): Process ended prematurely: osmo-stp_10.42.42.5(pid=27354) [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27354)] [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:45:36.901105 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:45:36.927336 run osmo-hlr_10.42.42.2(pid=27351): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27351)] 08:45:36.975423 run osmo-hlr_10.42.42.2(pid=27351): stdout: | (launched: 2022-12-13_08:45:34.149675) 08:45:37.024789 run osmo-hlr_10.42.42.2(pid=27351): stderr: | 20221213084534325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084534325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084534325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084534325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084534325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084534325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084534339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084534349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084534350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084534350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:37.093947 run osmo-msc_10.42.42.6(pid=27357): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27357)] 08:45:37.141206 run osmo-msc_10.42.42.6(pid=27357): stdout: | (launched: 2022-12-13_08:45:36.031671) 08:45:37.190387 run osmo-msc_10.42.42.6(pid=27357): stderr: | 20221213084536302 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084536303 DLGLOBAL DEBUG validating counter group 0x7f36bc153c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084536303 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084536303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084536303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084536303 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084536305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084536305 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084536305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084536306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:37.240100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27350): Terminating (SIGTERM) 08:45:37.279558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27353): Terminating (SIGTERM) 08:45:37.319207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27356): Terminating (SIGTERM) 08:45:37.359181 --- ParallelTerminationStrategy: PID 27350 died... 08:45:37.378462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27350): Terminated: ok {rc=0} 08:45:37.422436 --- ParallelTerminationStrategy: PID 27353 died... 08:45:37.441229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27353): Terminated: ok {rc=0} 08:45:37.485860 --- ParallelTerminationStrategy: PID 27356 died... 08:45:37.504575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27356): Terminated: ok {rc=0} 08:45:37.588221 bus /sierra_3: Setting Powered False 08:45:38.682627 bus /sierra_3: Setting Powered False 08:45:39.796499 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:45:40.941585 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:40.953791 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:45:41.010556 tst mo_mt_call_osmux.py: using LAC 32799 08:45:41.128206 tst mo_mt_call_osmux.py: using RAC 159 08:45:41.245281 tst mo_mt_call_osmux.py: using CellId 32799 08:45:41.371182 tst mo_mt_call_osmux.py: using BVCI 32800 08:45:41.488490 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:41.501075 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:41.512521 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:41.524321 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:41.535720 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:41.547427 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:45:41.666896 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:45:41.786000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:42.279481 run create_hlr_db(pid=27360): Launched 08:45:42.408826 bus /sierra_2: Setting Powered False 08:45:43.472163 run create_hlr_db(pid=27360): Terminated: ok {rc=0} 08:45:43.915006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27362): Launched 08:45:44.232101 run osmo-hlr_10.42.42.2(pid=27363): Launched 08:45:44.354670 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:44.909385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27365): Launched 08:45:45.227979 run osmo-stp_10.42.42.5(pid=27366): Launched 08:45:45.350486 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:45.928151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27368): Launched 08:45:46.257772 run osmo-msc_10.42.42.6(pid=27369): Launched 08:45:46.637063 run osmo-stp_10.42.42.5(pid=27366): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27366)] 08:45:46.846309 run osmo-stp_10.42.42.5(pid=27366): stdout: | (launched: 2022-12-13_08:45:45.170223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:46.988664 run osmo-stp_10.42.42.5(pid=27366): stderr: | 20221213084545362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084545362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084545362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084545363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084545363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084545363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084545363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:47.125627 run osmo-stp_10.42.42.5(pid=27366): stdout: | (launched: 2022-12-13_08:45:45.170223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:47.256429 run osmo-stp_10.42.42.5(pid=27366): stderr: | 20221213084545362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084545362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084545362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084545363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084545363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084545363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084545363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:47.412018 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27366): Process ended prematurely: osmo-stp_10.42.42.5(pid=27366) [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27366)] [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:45:47.422215 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:45:47.450784 run osmo-hlr_10.42.42.2(pid=27363): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27363)] 08:45:47.502424 run osmo-hlr_10.42.42.2(pid=27363): stdout: | (launched: 2022-12-13_08:45:44.174866) 08:45:47.554748 run osmo-hlr_10.42.42.2(pid=27363): stderr: | 20221213084544376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084544376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084544376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084544376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084544376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084544376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084544388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084544396 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084544396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084544396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:47.627794 run osmo-msc_10.42.42.6(pid=27369): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27369)] 08:45:47.677972 run osmo-msc_10.42.42.6(pid=27369): stdout: | (launched: 2022-12-13_08:45:46.194758) 08:45:47.730095 run osmo-msc_10.42.42.6(pid=27369): stderr: | 20221213084546624 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084546625 DLGLOBAL DEBUG validating counter group 0x7fd48be7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084546625 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084546625 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084546625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084546625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084546627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084546627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084546627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084546627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:47.782281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27362): Terminating (SIGTERM) 08:45:47.824131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27365): Terminating (SIGTERM) 08:45:47.865890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27368): Terminating (SIGTERM) 08:45:47.908188 --- ParallelTerminationStrategy: PID 27362 died... 08:45:47.928650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27362): Terminated: ok {rc=0} 08:45:47.975406 --- ParallelTerminationStrategy: PID 27365 died... 08:45:47.995251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27365): Terminated: ok {rc=0} 08:45:48.042075 --- ParallelTerminationStrategy: PID 27368 died... 08:45:48.061981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27368): Terminated: ok {rc=0} 08:45:48.148490 bus /sierra_3: Setting Powered False 08:45:49.246141 bus /sierra_3: Setting Powered False 08:45:50.360907 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:45:51.598745 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:51.604800 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:45:51.625977 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:45:51.653595 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:45:51.705732 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:45:51.726982 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:45:51.754552 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:45:52.301386 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:45:52.350443 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:45:52.361573 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:45:52.417569 tst mo_mt_call.py: using LAC 32800 08:45:52.545372 tst mo_mt_call.py: using RAC 160 08:45:52.670859 tst mo_mt_call.py: using CellId 32800 08:45:52.796703 tst mo_mt_call.py: using BVCI 32801 08:45:52.914577 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:45:52.926233 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:45:52.937534 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:45:52.948507 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:45:52.959559 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:45:52.971168 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:45:53.089454 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:45:53.207734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:53.702005 run create_hlr_db(pid=27374): Launched 08:45:53.831345 bus /sierra_2: Setting Powered False 08:45:54.895324 run create_hlr_db(pid=27374): Terminated: ok {rc=0} 08:45:55.337873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Launched 08:45:55.656060 run osmo-hlr_10.42.42.2(pid=27377): Launched 08:45:55.777957 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:56.326633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Launched 08:45:56.646738 run osmo-stp_10.42.42.5(pid=27380): Launched 08:45:56.768272 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:57.343947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27382): Launched 08:45:57.663747 run osmo-msc_10.42.42.6(pid=27383): Launched 08:45:57.841962 run osmo-stp_10.42.42.5(pid=27380): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] 08:45:57.976761 run osmo-stp_10.42.42.5(pid=27380): stdout: | (launched: 2022-12-13_08:45:56.589354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:58.112618 run osmo-stp_10.42.42.5(pid=27380): stderr: | 20221213084556782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084556782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084556783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084556783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084556783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084556783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084556783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:58.247333 run osmo-stp_10.42.42.5(pid=27380): stdout: | (launched: 2022-12-13_08:45:56.589354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:58.374855 run osmo-stp_10.42.42.5(pid=27380): stderr: | 20221213084556782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084556782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084556783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084556783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084556783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084556783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084556783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:58.528392 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27380): Process ended prematurely: osmo-stp_10.42.42.5(pid=27380) [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:45:58.538051 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:45:58.566122 run osmo-hlr_10.42.42.2(pid=27377): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27377)] 08:45:58.616615 run osmo-hlr_10.42.42.2(pid=27377): stdout: | (launched: 2022-12-13_08:45:55.598613) 08:45:58.669058 run osmo-hlr_10.42.42.2(pid=27377): stderr: | 20221213084555798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084555798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084555798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084555798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084555798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084555798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084555811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084555819 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084555819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084555819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:58.741890 run osmo-msc_10.42.42.6(pid=27383): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27383)] 08:45:58.791842 run osmo-msc_10.42.42.6(pid=27383): stdout: | (launched: 2022-12-13_08:45:57.606018) 08:45:58.843287 run osmo-msc_10.42.42.6(pid=27383): stderr: | 20221213084557927 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084557927 DLGLOBAL DEBUG validating counter group 0x7f789fc20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084557928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084557928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084557928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084557928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084557930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084557930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084557930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084557930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:58.895034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Terminating (SIGTERM) 08:45:58.936246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Terminating (SIGTERM) 08:45:58.977715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27382): Terminating (SIGTERM) 08:45:59.019915 --- ParallelTerminationStrategy: PID 27376 died... 08:45:59.040051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27376): Terminated: ok {rc=0} 08:45:59.086405 --- ParallelTerminationStrategy: PID 27379 died... 08:45:59.106151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27379): Terminated: ok {rc=0} 08:45:59.152181 --- ParallelTerminationStrategy: PID 27382 died... 08:45:59.171963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27382): Terminated: ok {rc=0} 08:45:59.258822 bus /sierra_3: Setting Powered False 08:46:00.354150 bus /sierra_3: Setting Powered False 08:46:01.467992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:46:02.618616 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:02.630354 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:46:02.689047 tst mo_mt_call_osmux.py: using LAC 32801 08:46:02.814824 tst mo_mt_call_osmux.py: using RAC 161 08:46:02.939768 tst mo_mt_call_osmux.py: using CellId 32801 08:46:03.059045 tst mo_mt_call_osmux.py: using BVCI 32802 08:46:03.169360 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:03.180453 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:03.191544 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:03.202368 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:03.213187 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:03.224670 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:46:03.346177 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:46:03.462466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:03.924248 run create_hlr_db(pid=27385): Launched 08:46:04.038038 bus /sierra_2: Setting Powered False 08:46:05.098931 run create_hlr_db(pid=27385): Terminated: ok {rc=0} 08:46:05.535403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27387): Launched 08:46:05.854409 run osmo-hlr_10.42.42.2(pid=27388): Launched 08:46:05.975322 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:06.523701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27390): Launched 08:46:06.841424 run osmo-stp_10.42.42.5(pid=27391): Launched 08:46:06.962905 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:07.544211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27393): Launched 08:46:07.863082 run osmo-msc_10.42.42.6(pid=27394): Launched 08:46:08.040759 run osmo-stp_10.42.42.5(pid=27391): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27391)] 08:46:08.175081 run osmo-stp_10.42.42.5(pid=27391): stdout: | (launched: 2022-12-13_08:46:06.784123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:08.310035 run osmo-stp_10.42.42.5(pid=27391): stderr: | 20221213084606977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084606978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084606978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084606978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084606979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084606979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084606979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:08.444024 run osmo-stp_10.42.42.5(pid=27391): stdout: | (launched: 2022-12-13_08:46:06.784123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:08.572584 run osmo-stp_10.42.42.5(pid=27391): stderr: | 20221213084606977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084606978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084606978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084606978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084606979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084606979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084606979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:08.724797 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27391): Process ended prematurely: osmo-stp_10.42.42.5(pid=27391) [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27391)] [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:46:08.734381 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:46:08.761986 run osmo-hlr_10.42.42.2(pid=27388): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27388)] 08:46:08.811865 run osmo-hlr_10.42.42.2(pid=27388): stdout: | (launched: 2022-12-13_08:46:05.797290) 08:46:08.863313 run osmo-hlr_10.42.42.2(pid=27388): stderr: | 20221213084605998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084605998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084605998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084605998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084605998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084605998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084606011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084606021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084606021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084606021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:08.935257 run osmo-msc_10.42.42.6(pid=27394): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27394)] 08:46:08.985452 run osmo-msc_10.42.42.6(pid=27394): stdout: | (launched: 2022-12-13_08:46:07.805543) 08:46:09.036829 run osmo-msc_10.42.42.6(pid=27394): stderr: | 20221213084608130 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084608130 DLGLOBAL DEBUG validating counter group 0x7f7aa4f11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084608130 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084608131 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084608131 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084608131 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084608133 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084608133 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084608133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084608133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:09.088724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27387): Terminating (SIGTERM) 08:46:09.129809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27390): Terminating (SIGTERM) 08:46:09.170959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27393): Terminating (SIGTERM) 08:46:09.212377 --- ParallelTerminationStrategy: PID 27387 died... 08:46:09.231866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27387): Terminated: ok {rc=0} 08:46:09.277435 --- ParallelTerminationStrategy: PID 27390 died... 08:46:09.296619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27390): Terminated: ok {rc=0} 08:46:09.342565 --- ParallelTerminationStrategy: PID 27393 died... 08:46:09.362004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27393): Terminated: ok {rc=0} 08:46:09.448869 bus /sierra_3: Setting Powered False 08:46:10.545836 bus /sierra_3: Setting Powered False 08:46:11.660355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:oc2g --------------------------------------------------------------------- 08:46:12.895215 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:46:12.899751 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 08:46:12.920539 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 08:46:12.947778 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 08:46:13.033315 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 08:46:13.054130 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 08:46:13.081066 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 08:46:13.665605 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 08:46:13.671027 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:13.682000 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:46:13.717599 tst emergency_mo_mt_call.py: using LAC 32802 08:46:13.840623 tst emergency_mo_mt_call.py: using RAC 162 08:46:13.963606 tst emergency_mo_mt_call.py: using CellId 32802 08:46:14.087573 tst emergency_mo_mt_call.py: using BVCI 32803 08:46:14.201617 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:14.212999 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:14.223813 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:14.234608 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:14.245358 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:14.256075 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:46:14.372429 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:46:14.485553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:14.939506 run create_hlr_db(pid=27400): Launched 08:46:15.051575 bus /sierra_2: Setting Powered False 08:46:16.115689 run create_hlr_db(pid=27400): Terminated: ok {rc=0} 08:46:16.571254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27402): Launched 08:46:16.905668 run osmo-hlr_10.42.42.2(pid=27403): Launched 08:46:17.134173 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:17.701594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27405): Launched 08:46:17.992221 run osmo-stp_10.42.42.5(pid=27406): Launched 08:46:18.113417 tst emergency_mo_mt_call.py: using MSISDN 8072 08:46:18.276937 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:18.800874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27408): Launched 08:46:19.091566 run osmo-msc_10.42.42.6(pid=27409): Launched 08:46:19.255835 run osmo-stp_10.42.42.5(pid=27406): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27406)] 08:46:19.380146 run osmo-stp_10.42.42.5(pid=27406): stdout: | (launched: 2022-12-13_08:46:17.938953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:19.504578 run osmo-stp_10.42.42.5(pid=27406): stderr: | 20221213084618111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084618111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084618111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084618112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084618112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084618113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084618113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:19.626745 run osmo-stp_10.42.42.5(pid=27406): stdout: | (launched: 2022-12-13_08:46:17.938953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:19.743340 run osmo-stp_10.42.42.5(pid=27406): stderr: | 20221213084618111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084618111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084618111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084618112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084618112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084618113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084618113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:19.882737 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27406): Process ended prematurely: osmo-stp_10.42.42.5(pid=27406) [trial-2387↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27406)] [trial-2387↪emergency:oc2g↪emergency_mo_mt_call.py:19] 08:46:19.891062 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 08:46:19.916699 run osmo-hlr_10.42.42.2(pid=27403): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27403)] 08:46:19.964473 run osmo-hlr_10.42.42.2(pid=27403): stdout: | (launched: 2022-12-13_08:46:16.836870) 08:46:20.013256 run osmo-hlr_10.42.42.2(pid=27403): stderr: | 20221213084617091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084617091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084617091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084617091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084617091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084617091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084617103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084617120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084617120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084617120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:20.081835 run osmo-msc_10.42.42.6(pid=27409): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27409)] 08:46:20.128941 run osmo-msc_10.42.42.6(pid=27409): stdout: | (launched: 2022-12-13_08:46:19.038513) 08:46:20.178086 run osmo-msc_10.42.42.6(pid=27409): stderr: | 20221213084619308 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084619308 DLGLOBAL DEBUG validating counter group 0x7fd7f4631c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084619308 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084619308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084619308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084619308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084619310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084619311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084619311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084619311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:20.227706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27402): Terminating (SIGTERM) 08:46:20.267870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27405): Terminating (SIGTERM) 08:46:20.307708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27408): Terminating (SIGTERM) 08:46:20.347955 --- ParallelTerminationStrategy: PID 27402 died... 08:46:20.367603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27402): Terminated: ok {rc=0} 08:46:20.411986 --- ParallelTerminationStrategy: PID 27405 died... 08:46:20.431152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27405): Terminated: ok {rc=0} 08:46:20.475699 --- ParallelTerminationStrategy: PID 27408 died... 08:46:20.494844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27408): Terminated: ok {rc=0} 08:46:20.578728 bus /sierra_3: Setting Powered False 08:46:21.676716 bus /sierra_3: Setting Powered False 08:46:22.794850 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 08:46:23.881728 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:23.892726 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:46:23.928592 tst emergency_preemptive_call.py: using LAC 32803 08:46:24.046275 tst emergency_preemptive_call.py: using RAC 163 08:46:24.162393 tst emergency_preemptive_call.py: using CellId 32803 08:46:24.276407 tst emergency_preemptive_call.py: using BVCI 32804 08:46:24.382078 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:24.392529 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:24.402928 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:24.413267 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:24.423470 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:46:24.434003 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:46:24.549237 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:46:24.668925 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:46:24.785065 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:46:24.903303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:25.392588 run create_hlr_db(pid=27411): Launched 08:46:25.521389 bus /sierra_2: Setting Powered False 08:46:26.583137 run create_hlr_db(pid=27411): Terminated: ok {rc=0} 08:46:27.020375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27413): Launched 08:46:27.334428 run osmo-hlr_10.42.42.2(pid=27414): Launched 08:46:27.453695 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:27.991814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27416): Launched 08:46:28.304183 run osmo-stp_10.42.42.5(pid=27417): Launched 08:46:28.433484 tst emergency_preemptive_call.py: using MSISDN 8073 08:46:28.594274 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:29.155596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27419): Launched 08:46:29.468559 run osmo-msc_10.42.42.6(pid=27420): Launched 08:46:29.644148 run osmo-stp_10.42.42.5(pid=27417): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27417)] 08:46:29.777964 run osmo-stp_10.42.42.5(pid=27417): stdout: | (launched: 2022-12-13_08:46:28.247260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:29.911946 run osmo-stp_10.42.42.5(pid=27417): stderr: | 20221213084628438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084628438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084628438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084628439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084628439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084628439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084628439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:30.044847 run osmo-stp_10.42.42.5(pid=27417): stdout: | (launched: 2022-12-13_08:46:28.247260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:30.170404 run osmo-stp_10.42.42.5(pid=27417): stderr: | 20221213084628438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084628438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084628438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084628439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084628439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084628439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084628439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:30.320269 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27417): Process ended prematurely: osmo-stp_10.42.42.5(pid=27417) [trial-2387↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27417)] [trial-2387↪emergency:oc2g↪emergency_preemptive_call.py:32] 08:46:30.329321 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 08:46:30.356756 run osmo-hlr_10.42.42.2(pid=27414): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27414)] 08:46:30.406993 run osmo-hlr_10.42.42.2(pid=27414): stdout: | (launched: 2022-12-13_08:46:27.277698) 08:46:30.458989 run osmo-hlr_10.42.42.2(pid=27414): stderr: | 20221213084627477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084627477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084627477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084627477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084627477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084627477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084627489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084627497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084627498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084627498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:30.531420 run osmo-msc_10.42.42.6(pid=27420): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27420)] 08:46:30.581319 run osmo-msc_10.42.42.6(pid=27420): stdout: | (launched: 2022-12-13_08:46:29.411599) 08:46:30.632719 run osmo-msc_10.42.42.6(pid=27420): stderr: | 20221213084629731 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213084629731 DLGLOBAL DEBUG validating counter group 0x7f5784dffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213084629731 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213084629731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213084629731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213084629731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213084629733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213084629734 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213084629734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213084629734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:30.684827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27413): Terminating (SIGTERM) 08:46:30.726246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27416): Terminating (SIGTERM) 08:46:30.767685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27419): Terminating (SIGTERM) 08:46:30.809612 --- ParallelTerminationStrategy: PID 27413 died... 08:46:30.829493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27413): Terminated: ok {rc=0} 08:46:30.875457 --- ParallelTerminationStrategy: PID 27416 died... 08:46:30.895335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27416): Terminated: ok {rc=0} 08:46:30.941535 --- ParallelTerminationStrategy: PID 27419 died... 08:46:30.961936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27419): Terminated: ok {rc=0} 08:46:31.058139 bus /sierra_9: Setting Powered False 08:46:32.172875 bus /sierra_9: Setting Powered False 08:46:33.317609 bus /sierra_8: Setting Powered False 08:46:34.418377 bus /sierra_8: Setting Powered False 08:46:35.533649 bus /sierra_3: Setting Powered False 08:46:36.630366 bus /sierra_3: Setting Powered False 08:46:37.746426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:oc2g --------------------------------------------------------------------- 08:46:39.010594 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:46:39.015229 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 08:46:39.036143 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 08:46:39.075393 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 08:46:39.164780 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 08:46:39.186632 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 08:46:39.226017 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 08:46:39.813835 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 08:46:39.864097 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:39.874606 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:46:39.908003 tst cs_paging_gprs_active.py: using LAC 32804 08:46:40.027345 tst cs_paging_gprs_active.py: using RAC 164 08:46:40.153327 tst cs_paging_gprs_active.py: using CellId 32804 08:46:40.278828 tst cs_paging_gprs_active.py: using BVCI 32805 08:46:40.397047 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.408093 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.419070 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.429790 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.440282 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.450953 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.462541 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.473465 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:40.484736 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:46:40.600620 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:46:40.718528 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:46:40.934363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:41.254244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27425): Launched 08:46:41.531576 run iperf3-srv_10.42.42.10(pid=27426): Launched 08:46:41.651557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:46:41.866753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:42.186621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27427): Launched 08:46:42.463821 run iperf3-srv_10.42.42.10(pid=27428): Launched 08:46:42.584623 tst cs_paging_gprs_active.py:38: start network... 08:46:42.800837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:43.295830 run create_hlr_db(pid=27429): Launched 08:46:43.425645 bus /sierra_2: Setting Powered False 08:46:44.489124 run create_hlr_db(pid=27429): Terminated: ok {rc=0} 08:46:44.914831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27431): Launched 08:46:45.212615 run osmo-hlr_10.42.42.2(pid=27432): Launched 08:46:45.327250 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:45.854711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27434): Launched 08:46:46.202497 run osmo-stp_10.42.42.5(pid=27435): Launched 08:46:46.426623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:47.057725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27437): Launched 08:46:47.177944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:47.433808 run patchelf(pid=27438): Launched 08:46:47.599592 run osmo-stp_10.42.42.5(pid=27435): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27435)] 08:46:47.726327 run osmo-stp_10.42.42.5(pid=27435): stdout: | (launched: 2022-12-13_08:46:46.139806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:47.854274 run osmo-stp_10.42.42.5(pid=27435): stderr: | 20221213084646337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084646337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084646338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084646338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084646339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084646339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084646339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:47.982327 run osmo-stp_10.42.42.5(pid=27435): stdout: | (launched: 2022-12-13_08:46:46.139806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:48.104408 run osmo-stp_10.42.42.5(pid=27435): stderr: | 20221213084646337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084646337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084646338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084646338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084646339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084646339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084646339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:48.248762 run patchelf(pid=27438): Terminating (SIGINT) 08:46:48.416787 run patchelf(pid=27438): Terminated: ok {rc=0} 08:46:48.537863 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27435): Process ended prematurely: osmo-stp_10.42.42.5(pid=27435) [trial-2387↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27435)] [trial-2387↪gprs:oc2g↪cs_paging_gprs_active.py:38] 08:46:48.547071 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:46:48.573968 run osmo-hlr_10.42.42.2(pid=27432): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27432)] 08:46:48.621745 run osmo-hlr_10.42.42.2(pid=27432): stdout: | (launched: 2022-12-13_08:46:45.158476) 08:46:48.670799 run osmo-hlr_10.42.42.2(pid=27432): stderr: | 20221213084645335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084645335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084645335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084645335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084645335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084645335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084645347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084645357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084645357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084645357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:48.720221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27425): Terminating (SIGTERM) 08:46:48.759915 run iperf3-srv_10.42.42.10(pid=27426): Terminating (SIGTERM) 08:46:48.799924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27427): Terminating (SIGTERM) 08:46:48.839721 run iperf3-srv_10.42.42.10(pid=27428): Terminating (SIGTERM) 08:46:48.879239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27431): Terminating (SIGTERM) 08:46:48.919065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27434): Terminating (SIGTERM) 08:46:48.958709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27437): Terminating (SIGTERM) 08:46:48.998703 --- ParallelTerminationStrategy: PID 27425 died... 08:46:49.018271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27425): Terminated: ok {rc=0} 08:46:49.062108 --- ParallelTerminationStrategy: PID 27426 died... 08:46:49.080723 run iperf3-srv_10.42.42.10(pid=27426): Terminated {rc=256} 08:46:49.124441 --- ParallelTerminationStrategy: PID 27427 died... 08:46:49.143098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27427): Terminated: ok {rc=0} 08:46:49.186658 --- ParallelTerminationStrategy: PID 27428 died... 08:46:49.205396 run iperf3-srv_10.42.42.10(pid=27428): Terminated {rc=256} 08:46:49.248802 --- ParallelTerminationStrategy: PID 27431 died... 08:46:49.267620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27431): Terminated: ok {rc=0} 08:46:49.311273 --- ParallelTerminationStrategy: PID 27434 died... 08:46:49.330179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27434): Terminated: ok {rc=0} 08:46:49.373815 --- ParallelTerminationStrategy: PID 27437 died... 08:46:49.392400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27437): Terminated: ok {rc=0} 08:46:49.475761 bus /gobi_0: Setting Powered False 08:46:50.569002 bus /gobi_0: Setting Powered False 08:46:51.682367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g iperf3.py ---------------------------------------------- 08:46:52.826356 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:52.837367 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:46:52.872812 tst iperf3.py: using LAC 32805 08:46:53.000690 tst iperf3.py: using RAC 165 08:46:53.127856 tst iperf3.py: using CellId 32805 08:46:53.253384 tst iperf3.py: using BVCI 32806 08:46:53.368889 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.379996 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.390983 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.401914 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.412664 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.423270 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.434263 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.445258 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:46:53.456026 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:46:53.574038 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:46:53.775236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:54.074135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27439): Launched 08:46:54.333168 run iperf3-srv_10.42.42.10(pid=27440): Launched 08:46:54.445053 tst iperf3.py:8: start network... 08:46:54.644369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:55.104672 run create_hlr_db(pid=27441): Launched 08:46:55.218472 bus /gobi_6: Setting Powered False 08:46:56.278305 run create_hlr_db(pid=27441): Terminated: ok {rc=0} 08:46:56.714294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27443): Launched 08:46:57.035262 run osmo-hlr_10.42.42.2(pid=27444): Launched 08:46:57.157253 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:57.709062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27446): Launched 08:46:58.028259 run osmo-stp_10.42.42.5(pid=27447): Launched 08:46:58.150930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:58.704419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27449): Launched 08:46:58.826856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:59.097460 run patchelf(pid=27450): Launched 08:46:59.275291 run osmo-stp_10.42.42.5(pid=27447): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27447)] 08:46:59.410692 run osmo-stp_10.42.42.5(pid=27447): stdout: | (launched: 2022-12-13_08:46:57.970739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:59.547788 run osmo-stp_10.42.42.5(pid=27447): stderr: | 20221213084658163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084658163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084658164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084658164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084658164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084658165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084658165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:59.685074 run osmo-stp_10.42.42.5(pid=27447): stdout: | (launched: 2022-12-13_08:46:57.970739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:59.816119 run osmo-stp_10.42.42.5(pid=27447): stderr: | 20221213084658163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084658163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084658164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084658164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084658164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084658165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084658165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:59.971540 run patchelf(pid=27450): Terminating (SIGINT) 08:47:00.150600 run patchelf(pid=27450): Terminated: ok {rc=0} 08:47:00.279817 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27447): Process ended prematurely: osmo-stp_10.42.42.5(pid=27447) [trial-2387↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27447)] [trial-2387↪gprs:oc2g↪iperf3.py:8] 08:47:00.289932 tst iperf3.py:8: Test FAILED (7.5 sec) 08:47:00.318311 run osmo-hlr_10.42.42.2(pid=27444): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27444)] 08:47:00.368162 run osmo-hlr_10.42.42.2(pid=27444): stdout: | (launched: 2022-12-13_08:46:56.977219) 08:47:00.419658 run osmo-hlr_10.42.42.2(pid=27444): stderr: | 20221213084657174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084657174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084657174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084657174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084657174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084657174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084657191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084657200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084657201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084657201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:00.471986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27439): Terminating (SIGTERM) 08:47:00.513629 run iperf3-srv_10.42.42.10(pid=27440): Terminating (SIGTERM) 08:47:00.556243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27443): Terminating (SIGTERM) 08:47:00.598448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27446): Terminating (SIGTERM) 08:47:00.640277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27449): Terminating (SIGTERM) 08:47:00.682400 --- ParallelTerminationStrategy: PID 27439 died... 08:47:00.702661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27439): Terminated: ok {rc=0} 08:47:00.748812 --- ParallelTerminationStrategy: PID 27440 died... 08:47:00.768378 run iperf3-srv_10.42.42.10(pid=27440): Terminated {rc=256} 08:47:00.814337 --- ParallelTerminationStrategy: PID 27443 died... 08:47:00.834052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27443): Terminated: ok {rc=0} 08:47:00.880134 --- ParallelTerminationStrategy: PID 27446 died... 08:47:00.900071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27446): Terminated: ok {rc=0} 08:47:00.958805 --- ParallelTerminationStrategy: PID 27449 died... 08:47:00.994811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27449): Terminated: ok {rc=0} 08:47:01.088358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g iperf3m4.py ---------------------------------------------- 08:47:02.267492 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.282098 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:47:02.324775 tst iperf3m4.py: using LAC 32806 08:47:02.453521 tst iperf3m4.py: using RAC 166 08:47:02.571481 tst iperf3m4.py: using CellId 32806 08:47:02.697905 tst iperf3m4.py: using BVCI 32807 08:47:02.814477 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.825611 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.836519 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.847472 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.858361 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.869238 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.880196 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.891128 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:02.902000 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:47:03.021301 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:47:03.147140 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:47:03.276903 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:47:03.395130 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:47:03.612298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:03.933167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27451): Launched 08:47:04.211423 run iperf3-srv_10.42.42.10(pid=27452): Launched 08:47:04.331477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:47:04.548242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:04.869073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27453): Launched 08:47:05.146793 run iperf3-srv_10.42.42.10(pid=27454): Launched 08:47:05.266600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:47:05.481931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:05.802178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27455): Launched 08:47:06.077920 run iperf3-srv_10.42.42.10(pid=27456): Launched 08:47:06.197452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:47:06.412558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:06.732900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27457): Launched 08:47:07.009890 run iperf3-srv_10.42.42.10(pid=27459): Launched 08:47:07.129356 tst iperf3m4.py:8: start network... 08:47:07.344195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:07.839801 run create_hlr_db(pid=27460): Launched 08:47:07.969798 bus /gobi_6: Setting Powered False 08:47:09.033519 run create_hlr_db(pid=27460): Terminated: ok {rc=0} 08:47:09.458538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27462): Launched 08:47:09.756340 run osmo-hlr_10.42.42.2(pid=27463): Launched 08:47:09.870012 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:10.394300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27465): Launched 08:47:10.692242 run osmo-stp_10.42.42.5(pid=27466): Launched 08:47:10.805967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:11.321699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27468): Launched 08:47:11.435573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:11.687542 run patchelf(pid=27469): Launched 08:47:11.853639 run osmo-stp_10.42.42.5(pid=27466): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27466)] 08:47:11.979633 run osmo-stp_10.42.42.5(pid=27466): stdout: | (launched: 2022-12-13_08:47:10.638116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:12.107464 run osmo-stp_10.42.42.5(pid=27466): stderr: | 20221213084710806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084710806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084710807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084710807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084710808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084710808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084710808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:12.235563 run osmo-stp_10.42.42.5(pid=27466): stdout: | (launched: 2022-12-13_08:47:10.638116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:12.357381 run osmo-stp_10.42.42.5(pid=27466): stderr: | 20221213084710806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084710806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084710807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084710807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084710808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084710808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084710808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:12.502137 run patchelf(pid=27469): Terminating (SIGINT) 08:47:12.668922 run patchelf(pid=27469): Terminated: ok {rc=0} 08:47:12.788872 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27466): Process ended prematurely: osmo-stp_10.42.42.5(pid=27466) [trial-2387↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27466)] [trial-2387↪gprs:oc2g↪iperf3m4.py:8] 08:47:12.798250 tst iperf3m4.py:8: Test FAILED (10.6 sec) 08:47:12.825214 run osmo-hlr_10.42.42.2(pid=27463): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27463)] 08:47:12.873134 run osmo-hlr_10.42.42.2(pid=27463): stdout: | (launched: 2022-12-13_08:47:09.702424) 08:47:12.922289 run osmo-hlr_10.42.42.2(pid=27463): stderr: | 20221213084709880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084709880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084709880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084709880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084709880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084709880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084709893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084709901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084709901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084709901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:12.972092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27451): Terminating (SIGTERM) 08:47:13.011885 run iperf3-srv_10.42.42.10(pid=27452): Terminating (SIGTERM) 08:47:13.051301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27453): Terminating (SIGTERM) 08:47:13.090693 run iperf3-srv_10.42.42.10(pid=27454): Terminating (SIGTERM) 08:47:13.130124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27455): Terminating (SIGTERM) 08:47:13.169538 run iperf3-srv_10.42.42.10(pid=27456): Terminating (SIGTERM) 08:47:13.208858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27457): Terminating (SIGTERM) 08:47:13.248095 run iperf3-srv_10.42.42.10(pid=27459): Terminating (SIGTERM) 08:47:13.287432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27462): Terminating (SIGTERM) 08:47:13.326897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27465): Terminating (SIGTERM) 08:47:13.366329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27468): Terminating (SIGTERM) 08:47:13.406148 --- ParallelTerminationStrategy: PID 27451 died... 08:47:13.425706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27451): Terminated: ok {rc=0} 08:47:13.469806 --- ParallelTerminationStrategy: PID 27452 died... 08:47:13.488649 run iperf3-srv_10.42.42.10(pid=27452): Terminated {rc=256} 08:47:13.532434 --- ParallelTerminationStrategy: PID 27453 died... 08:47:13.551244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27453): Terminated: ok {rc=0} 08:47:13.594898 --- ParallelTerminationStrategy: PID 27454 died... 08:47:13.613740 run iperf3-srv_10.42.42.10(pid=27454): Terminated {rc=256} 08:47:13.657227 --- ParallelTerminationStrategy: PID 27455 died... 08:47:13.676011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27455): Terminated: ok {rc=0} 08:47:13.719765 --- ParallelTerminationStrategy: PID 27456 died... 08:47:13.738424 run iperf3-srv_10.42.42.10(pid=27456): Terminated {rc=256} 08:47:13.782035 --- ParallelTerminationStrategy: PID 27457 died... 08:47:13.800838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27457): Terminated: ok {rc=0} 08:47:13.844585 --- ParallelTerminationStrategy: PID 27459 died... 08:47:13.863514 run iperf3-srv_10.42.42.10(pid=27459): Terminated {rc=256} 08:47:13.907298 --- ParallelTerminationStrategy: PID 27462 died... 08:47:13.926227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27462): Terminated: ok {rc=0} 08:47:13.969678 --- ParallelTerminationStrategy: PID 27465 died... 08:47:13.988637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27465): Terminated: ok {rc=0} 08:47:14.032452 --- ParallelTerminationStrategy: PID 27468 died... 08:47:14.051280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27468): Terminated: ok {rc=0} 08:47:14.136270 bus /gobi_4: Setting Powered False 08:47:15.235073 bus /gobi_4: Setting Powered False 08:47:16.343907 bus /gobi_1: Setting Powered False 08:47:17.437885 bus /gobi_1: Setting Powered False 08:47:18.552180 bus /gobi_0: Setting Powered False 08:47:19.650282 bus /gobi_0: Setting Powered False 08:47:20.761644 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g ping.py ---------------------------------------------- 08:47:21.860058 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:21.871126 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:47:21.909086 tst ping.py: using LAC 32807 08:47:22.023237 tst ping.py: using RAC 167 08:47:22.137478 tst ping.py: using CellId 32807 08:47:22.261177 tst ping.py: using BVCI 32808 08:47:22.375859 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:22.387065 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:22.398077 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:22.409008 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:22.420397 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:22.431681 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:22.443090 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:22.454455 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:47:22.569203 tst ping.py:19: start network... 08:47:22.764655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:23.214702 run create_hlr_db(pid=27470): Launched 08:47:23.345930 bus /gobi_6: Setting Powered False 08:47:24.407583 run create_hlr_db(pid=27470): Terminated: ok {rc=0} 08:47:24.842720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27472): Launched 08:47:25.156647 run osmo-hlr_10.42.42.2(pid=27473): Launched 08:47:25.275988 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:25.820579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27475): Launched 08:47:26.134783 run osmo-stp_10.42.42.5(pid=27476): Launched 08:47:26.254731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:26.797456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27478): Launched 08:47:26.917336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:27.184400 run patchelf(pid=27479): Launched 08:47:27.359583 run osmo-stp_10.42.42.5(pid=27476): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27476)] 08:47:27.493182 run osmo-stp_10.42.42.5(pid=27476): stdout: | (launched: 2022-12-13_08:47:26.077718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:27.628497 run osmo-stp_10.42.42.5(pid=27476): stderr: | 20221213084726270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084726270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084726270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084726270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084726271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084726271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084726271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:27.763235 run osmo-stp_10.42.42.5(pid=27476): stdout: | (launched: 2022-12-13_08:47:26.077718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:27.892619 run osmo-stp_10.42.42.5(pid=27476): stderr: | 20221213084726270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084726270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084726270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084726270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084726271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084726271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084726271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:28.045932 run patchelf(pid=27479): Terminating (SIGINT) 08:47:28.222000 run patchelf(pid=27479): Terminated: ok {rc=0} 08:47:28.348783 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27476): Process ended prematurely: osmo-stp_10.42.42.5(pid=27476) [trial-2387↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27476)] [trial-2387↪gprs:oc2g↪ping.py:22] 08:47:28.358149 tst ping.py:22: Test FAILED (6.5 sec) 08:47:28.386393 run osmo-hlr_10.42.42.2(pid=27473): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27473)] 08:47:28.436693 run osmo-hlr_10.42.42.2(pid=27473): stdout: | (launched: 2022-12-13_08:47:25.099341) 08:47:28.488715 run osmo-hlr_10.42.42.2(pid=27473): stderr: | 20221213084725297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084725297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084725297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084725297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084725297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084725297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084725310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084725318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084725319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084725319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:28.540835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27472): Terminating (SIGTERM) 08:47:28.583605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27475): Terminating (SIGTERM) 08:47:28.625681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27478): Terminating (SIGTERM) 08:47:28.667964 --- ParallelTerminationStrategy: PID 27472 died... 08:47:28.688247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27472): Terminated: ok {rc=0} 08:47:28.734785 --- ParallelTerminationStrategy: PID 27475 died... 08:47:28.754714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27475): Terminated: ok {rc=0} 08:47:28.801353 --- ParallelTerminationStrategy: PID 27478 died... 08:47:28.820858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27478): Terminated: ok {rc=0} 08:47:28.908052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 08:47:29.995523 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.007149 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:47:30.044163 tst ping_idle_ping.py: using LAC 32808 08:47:30.163157 tst ping_idle_ping.py: using RAC 168 08:47:30.279462 tst ping_idle_ping.py: using CellId 32808 08:47:30.397235 tst ping_idle_ping.py: using BVCI 32809 08:47:30.505666 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.516106 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.526464 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.536592 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.546734 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.557844 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.568795 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:47:30.580649 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:47:30.695500 tst ping_idle_ping.py:24: start network... 08:47:30.893325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:31.393490 run create_hlr_db(pid=27480): Launched 08:47:31.555988 bus /gobi_6: Setting Powered False 08:47:32.619072 run create_hlr_db(pid=27480): Terminated: ok {rc=0} 08:47:33.058174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27482): Launched 08:47:33.372655 run osmo-hlr_10.42.42.2(pid=27483): Launched 08:47:33.492425 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:34.033040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27485): Launched 08:47:34.347016 run osmo-stp_10.42.42.5(pid=27486): Launched 08:47:34.466317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:35.009501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27488): Launched 08:47:35.129774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:35.396618 run patchelf(pid=27489): Launched 08:47:35.572089 run osmo-stp_10.42.42.5(pid=27486): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27486)] 08:47:35.705917 run osmo-stp_10.42.42.5(pid=27486): stdout: | (launched: 2022-12-13_08:47:34.290046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:35.841161 run osmo-stp_10.42.42.5(pid=27486): stderr: | 20221213084734480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084734480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084734480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084734480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084734483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084734483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084734483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:35.976542 run osmo-stp_10.42.42.5(pid=27486): stdout: | (launched: 2022-12-13_08:47:34.290046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:36.106220 run osmo-stp_10.42.42.5(pid=27486): stderr: | 20221213084734480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084734480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084734480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084734480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084734483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084734483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084734483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:36.259811 run patchelf(pid=27489): Terminating (SIGINT) 08:47:36.436366 run patchelf(pid=27489): Terminated: ok {rc=0} 08:47:36.564674 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27486): Process ended prematurely: osmo-stp_10.42.42.5(pid=27486) [trial-2387↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27486)] [trial-2387↪gprs:oc2g↪ping_idle_ping.py:27] 08:47:36.574396 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:47:36.602701 run osmo-hlr_10.42.42.2(pid=27483): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27483)] 08:47:36.652809 run osmo-hlr_10.42.42.2(pid=27483): stdout: | (launched: 2022-12-13_08:47:33.315745) 08:47:36.704474 run osmo-hlr_10.42.42.2(pid=27483): stderr: | 20221213084733513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084733513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084733513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084733513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084733513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084733513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084733526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084733536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084733536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084733536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:36.756401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27482): Terminating (SIGTERM) 08:47:36.797730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27485): Terminating (SIGTERM) 08:47:36.839344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27488): Terminating (SIGTERM) 08:47:36.881337 --- ParallelTerminationStrategy: PID 27482 died... 08:47:36.901582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27482): Terminated: ok {rc=0} 08:47:36.947404 --- ParallelTerminationStrategy: PID 27485 died... 08:47:36.967084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27485): Terminated: ok {rc=0} 08:47:37.013499 --- ParallelTerminationStrategy: PID 27488 died... 08:47:37.033240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27488): Terminated: ok {rc=0} 08:47:37.119909 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 08:47:38.410590 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:47:38.416286 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:47:38.436571 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:47:38.475941 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:47:38.559166 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:47:38.579228 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:47:38.616879 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:47:39.210617 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:47:39.258294 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.268846 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:47:39.302668 tst cs_paging_gprs_active.py: using LAC 32809 08:47:39.416523 tst cs_paging_gprs_active.py: using RAC 169 08:47:39.530769 tst cs_paging_gprs_active.py: using CellId 32809 08:47:39.644028 tst cs_paging_gprs_active.py: using BVCI 32810 08:47:39.750796 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.761480 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.771912 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.782309 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.792490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.802969 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.813739 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.824781 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:39.836032 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:47:39.955658 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:47:40.072647 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:47:40.285588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:40.600444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27494): Launched 08:47:40.873923 run iperf3-srv_10.42.42.10(pid=27495): Launched 08:47:40.991424 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:47:41.203424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:41.518708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27496): Launched 08:47:41.791768 run iperf3-srv_10.42.42.10(pid=27497): Launched 08:47:41.909848 tst cs_paging_gprs_active.py:38: start network... 08:47:42.121643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:42.610778 run create_hlr_db(pid=27498): Launched 08:47:42.726945 bus /gobi_6: Setting Powered False 08:47:43.786298 run create_hlr_db(pid=27498): Terminated: ok {rc=0} 08:47:44.194777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27500): Launched 08:47:44.487893 run osmo-hlr_10.42.42.2(pid=27501): Launched 08:47:44.602314 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:45.120260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27503): Launched 08:47:45.413873 run osmo-stp_10.42.42.5(pid=27504): Launched 08:47:45.526529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:46.046795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27506): Launched 08:47:46.174358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:46.432929 run patchelf(pid=27507): Launched 08:47:46.615786 run osmo-stp_10.42.42.5(pid=27504): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27504)] 08:47:46.744621 run osmo-stp_10.42.42.5(pid=27504): stdout: | (launched: 2022-12-13_08:47:45.360800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:46.875146 run osmo-stp_10.42.42.5(pid=27504): stderr: | 20221213084745530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084745530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084745530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084745530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084745531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084745531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084745531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:47.005824 run osmo-stp_10.42.42.5(pid=27504): stdout: | (launched: 2022-12-13_08:47:45.360800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:47.130327 run osmo-stp_10.42.42.5(pid=27504): stderr: | 20221213084745530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084745530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084745530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084745530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084745531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084745531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084745531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:47.279165 run patchelf(pid=27507): Terminating (SIGINT) 08:47:47.446738 run patchelf(pid=27507): Terminated: ok {rc=0} 08:47:47.566675 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27504): Process ended prematurely: osmo-stp_10.42.42.5(pid=27504) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27504)] [trial-2387↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:47:47.576051 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 08:47:47.602903 run osmo-hlr_10.42.42.2(pid=27501): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27501)] 08:47:47.650828 run osmo-hlr_10.42.42.2(pid=27501): stdout: | (launched: 2022-12-13_08:47:44.434910) 08:47:47.700630 run osmo-hlr_10.42.42.2(pid=27501): stderr: | 20221213084744611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084744611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084744611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084744611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084744611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084744611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084744623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084744632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084744632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084744632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:47.750329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27494): Terminating (SIGTERM) 08:47:47.790381 run iperf3-srv_10.42.42.10(pid=27495): Terminating (SIGTERM) 08:47:47.830102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27496): Terminating (SIGTERM) 08:47:47.869975 run iperf3-srv_10.42.42.10(pid=27497): Terminating (SIGTERM) 08:47:47.910400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27500): Terminating (SIGTERM) 08:47:47.954502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27503): Terminating (SIGTERM) 08:47:47.996360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27506): Terminating (SIGTERM) 08:47:48.038588 --- ParallelTerminationStrategy: PID 27494 died... 08:47:48.058635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27494): Terminated: ok {rc=0} 08:47:48.105263 --- ParallelTerminationStrategy: PID 27495 died... 08:47:48.125068 run iperf3-srv_10.42.42.10(pid=27495): Terminated {rc=256} 08:47:48.170861 --- ParallelTerminationStrategy: PID 27496 died... 08:47:48.190488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27496): Terminated: ok {rc=0} 08:47:48.236127 --- ParallelTerminationStrategy: PID 27497 died... 08:47:48.255520 run iperf3-srv_10.42.42.10(pid=27497): Terminated {rc=256} 08:47:48.301110 --- ParallelTerminationStrategy: PID 27500 died... 08:47:48.320329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27500): Terminated: ok {rc=0} 08:47:48.365845 --- ParallelTerminationStrategy: PID 27503 died... 08:47:48.385238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27503): Terminated: ok {rc=0} 08:47:48.430988 --- ParallelTerminationStrategy: PID 27506 died... 08:47:48.450557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27506): Terminated: ok {rc=0} 08:47:48.537777 bus /gobi_0: Setting Powered False 08:47:49.632862 bus /gobi_0: Setting Powered False 08:47:50.746852 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:47:51.890324 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:51.901434 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:47:51.937412 tst iperf3.py: using LAC 32810 08:47:52.063218 tst iperf3.py: using RAC 170 08:47:52.186821 tst iperf3.py: using CellId 32810 08:47:52.309876 tst iperf3.py: using BVCI 32811 08:47:52.424933 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.436285 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.447587 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.458766 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.469764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.480504 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.491560 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.502529 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:52.513649 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:47:52.633824 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:47:52.845418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:53.159784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27508): Launched 08:47:53.432134 run iperf3-srv_10.42.42.10(pid=27509): Launched 08:47:53.549793 tst iperf3.py:8: start network... 08:47:53.762257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:54.248417 run create_hlr_db(pid=27510): Launched 08:47:54.376049 bus /gobi_6: Setting Powered False 08:47:55.438550 run create_hlr_db(pid=27510): Terminated: ok {rc=0} 08:47:55.875118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27512): Launched 08:47:56.187294 run osmo-hlr_10.42.42.2(pid=27513): Launched 08:47:56.306818 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:56.850334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27515): Launched 08:47:57.164085 run osmo-stp_10.42.42.5(pid=27516): Launched 08:47:57.284191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:57.827618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27518): Launched 08:47:57.947680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:58.212686 run patchelf(pid=27519): Launched 08:47:58.387149 run osmo-stp_10.42.42.5(pid=27516): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27516)] 08:47:58.520372 run osmo-stp_10.42.42.5(pid=27516): stdout: | (launched: 2022-12-13_08:47:57.107476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:58.655813 run osmo-stp_10.42.42.5(pid=27516): stderr: | 20221213084757301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084757302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084757302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084757302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084757303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084757303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084757303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:58.790883 run osmo-stp_10.42.42.5(pid=27516): stdout: | (launched: 2022-12-13_08:47:57.107476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:58.920419 run osmo-stp_10.42.42.5(pid=27516): stderr: | 20221213084757301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084757302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084757302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084757302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084757303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084757303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084757303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:59.073614 run patchelf(pid=27519): Terminating (SIGINT) 08:47:59.250168 run patchelf(pid=27519): Terminated: ok {rc=0} 08:47:59.378269 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27516): Process ended prematurely: osmo-stp_10.42.42.5(pid=27516) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27516)] [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 08:47:59.388280 tst iperf3.py:8: Test FAILED (7.5 sec) 08:47:59.416385 run osmo-hlr_10.42.42.2(pid=27513): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27513)] 08:47:59.466188 run osmo-hlr_10.42.42.2(pid=27513): stdout: | (launched: 2022-12-13_08:47:56.130994) 08:47:59.518318 run osmo-hlr_10.42.42.2(pid=27513): stderr: | 20221213084756331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084756331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084756331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084756331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084756331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084756331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084756343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084756352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084756352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084756352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:59.570647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27508): Terminating (SIGTERM) 08:47:59.612864 run iperf3-srv_10.42.42.10(pid=27509): Terminating (SIGTERM) 08:47:59.654817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27512): Terminating (SIGTERM) 08:47:59.696725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27515): Terminating (SIGTERM) 08:47:59.738231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27518): Terminating (SIGTERM) 08:47:59.779748 --- ParallelTerminationStrategy: PID 27508 died... 08:47:59.799455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27508): Terminated: ok {rc=0} 08:47:59.845474 --- ParallelTerminationStrategy: PID 27509 died... 08:47:59.865086 run iperf3-srv_10.42.42.10(pid=27509): Terminated {rc=256} 08:47:59.910961 --- ParallelTerminationStrategy: PID 27512 died... 08:47:59.930359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27512): Terminated: ok {rc=0} 08:47:59.976027 --- ParallelTerminationStrategy: PID 27515 died... 08:47:59.995471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27515): Terminated: ok {rc=0} 08:48:00.041307 --- ParallelTerminationStrategy: PID 27518 died... 08:48:00.060762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27518): Terminated: ok {rc=0} 08:48:00.148354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:48:01.292512 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.304770 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:48:01.342640 tst iperf3m4.py: using LAC 32811 08:48:01.478891 tst iperf3m4.py: using RAC 171 08:48:01.626625 tst iperf3m4.py: using CellId 32811 08:48:01.759578 tst iperf3m4.py: using BVCI 32812 08:48:01.906564 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.918129 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.929764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.941247 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.955144 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.968001 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.980862 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:01.993474 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:02.006343 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:02.129655 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:02.276827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:02.401062 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:02.520087 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:48:02.732438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:03.046989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27520): Launched 08:48:03.318448 run iperf3-srv_10.42.42.10(pid=27521): Launched 08:48:03.436351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:48:03.648005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:03.961503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27522): Launched 08:48:04.231766 run iperf3-srv_10.42.42.10(pid=27523): Launched 08:48:04.348772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:48:04.559437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:04.875046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27524): Launched 08:48:05.146352 run iperf3-srv_10.42.42.10(pid=27525): Launched 08:48:05.263221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:48:05.474572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:05.788667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27526): Launched 08:48:06.059984 run iperf3-srv_10.42.42.10(pid=27527): Launched 08:48:06.177050 tst iperf3m4.py:8: start network... 08:48:06.387345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:06.874391 run create_hlr_db(pid=27528): Launched 08:48:07.001439 bus /gobi_6: Setting Powered False 08:48:08.063579 run create_hlr_db(pid=27528): Terminated: ok {rc=0} 08:48:08.481729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27530): Launched 08:48:08.775038 run osmo-hlr_10.42.42.2(pid=27531): Launched 08:48:08.887498 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:09.397040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27533): Launched 08:48:09.690204 run osmo-stp_10.42.42.5(pid=27534): Launched 08:48:09.802167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:10.309995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27536): Launched 08:48:10.424543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:10.674244 run patchelf(pid=27537): Launched 08:48:10.838094 run osmo-stp_10.42.42.5(pid=27534): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27534)] 08:48:10.962825 run osmo-stp_10.42.42.5(pid=27534): stdout: | (launched: 2022-12-13_08:48:09.637077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:11.089384 run osmo-stp_10.42.42.5(pid=27534): stderr: | 20221213084809803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084809803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084809803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084809804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084809806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084809806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084809806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:11.216017 run osmo-stp_10.42.42.5(pid=27534): stdout: | (launched: 2022-12-13_08:48:09.637077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:11.337077 run osmo-stp_10.42.42.5(pid=27534): stderr: | 20221213084809803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084809803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084809803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084809804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084809806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084809806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084809806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:11.480859 run patchelf(pid=27537): Terminating (SIGINT) 08:48:11.645804 run patchelf(pid=27537): Terminated: ok {rc=0} 08:48:11.764914 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27534): Process ended prematurely: osmo-stp_10.42.42.5(pid=27534) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27534)] [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 08:48:11.774657 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:48:11.801581 run osmo-hlr_10.42.42.2(pid=27531): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27531)] 08:48:11.849401 run osmo-hlr_10.42.42.2(pid=27531): stdout: | (launched: 2022-12-13_08:48:08.721652) 08:48:11.898869 run osmo-hlr_10.42.42.2(pid=27531): stderr: | 20221213084808896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084808897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084808897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084808897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084808897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084808897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084808910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084808918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084808918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084808919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:11.948379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27520): Terminating (SIGTERM) 08:48:11.988077 run iperf3-srv_10.42.42.10(pid=27521): Terminating (SIGTERM) 08:48:12.027709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27522): Terminating (SIGTERM) 08:48:12.067391 run iperf3-srv_10.42.42.10(pid=27523): Terminating (SIGTERM) 08:48:12.107041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27524): Terminating (SIGTERM) 08:48:12.146663 run iperf3-srv_10.42.42.10(pid=27525): Terminating (SIGTERM) 08:48:12.186210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27526): Terminating (SIGTERM) 08:48:12.225791 run iperf3-srv_10.42.42.10(pid=27527): Terminating (SIGTERM) 08:48:12.265300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27530): Terminating (SIGTERM) 08:48:12.304679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27533): Terminating (SIGTERM) 08:48:12.344356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27536): Terminating (SIGTERM) 08:48:12.384258 --- ParallelTerminationStrategy: PID 27520 died... 08:48:12.403611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27520): Terminated: ok {rc=0} 08:48:12.447619 --- ParallelTerminationStrategy: PID 27521 died... 08:48:12.466442 run iperf3-srv_10.42.42.10(pid=27521): Terminated {rc=256} 08:48:12.510142 --- ParallelTerminationStrategy: PID 27522 died... 08:48:12.528913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27522): Terminated: ok {rc=0} 08:48:12.572205 --- ParallelTerminationStrategy: PID 27523 died... 08:48:12.590928 run iperf3-srv_10.42.42.10(pid=27523): Terminated {rc=256} 08:48:12.634358 --- ParallelTerminationStrategy: PID 27524 died... 08:48:12.653185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27524): Terminated: ok {rc=0} 08:48:12.696462 --- ParallelTerminationStrategy: PID 27525 died... 08:48:12.714960 run iperf3-srv_10.42.42.10(pid=27525): Terminated {rc=256} 08:48:12.758301 --- ParallelTerminationStrategy: PID 27526 died... 08:48:12.776910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27526): Terminated: ok {rc=0} 08:48:12.820203 --- ParallelTerminationStrategy: PID 27527 died... 08:48:12.838935 run iperf3-srv_10.42.42.10(pid=27527): Terminated {rc=256} 08:48:12.882313 --- ParallelTerminationStrategy: PID 27530 died... 08:48:12.900740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27530): Terminated: ok {rc=0} 08:48:12.944139 --- ParallelTerminationStrategy: PID 27533 died... 08:48:12.962640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27533): Terminated: ok {rc=0} 08:48:13.005999 --- ParallelTerminationStrategy: PID 27536 died... 08:48:13.024405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27536): Terminated: ok {rc=0} 08:48:13.107635 bus /gobi_4: Setting Powered False 08:48:14.200355 bus /gobi_4: Setting Powered False 08:48:15.314586 bus /gobi_1: Setting Powered False 08:48:16.419577 bus /gobi_1: Setting Powered False 08:48:17.536134 bus /gobi_0: Setting Powered False 08:48:18.632105 bus /gobi_0: Setting Powered False 08:48:19.745800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 08:48:20.847952 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:20.859700 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:48:20.896654 tst ping.py: using LAC 32812 08:48:21.017776 tst ping.py: using RAC 172 08:48:21.138318 tst ping.py: using CellId 32812 08:48:21.258444 tst ping.py: using BVCI 32813 08:48:21.369910 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:21.381089 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:21.392087 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:21.402975 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:21.413828 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:21.424579 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:21.436103 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:21.447270 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:21.560872 tst ping.py:19: start network... 08:48:21.752703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:22.197589 run create_hlr_db(pid=27540): Launched 08:48:22.308301 bus /gobi_6: Setting Powered False 08:48:23.365704 run create_hlr_db(pid=27540): Terminated: ok {rc=0} 08:48:23.787940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27542): Launched 08:48:24.095765 run osmo-hlr_10.42.42.2(pid=27543): Launched 08:48:24.213327 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:24.745067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27545): Launched 08:48:25.052388 run osmo-stp_10.42.42.5(pid=27546): Launched 08:48:25.170626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:25.705282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27548): Launched 08:48:25.822991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:26.082775 run patchelf(pid=27549): Launched 08:48:26.254349 run osmo-stp_10.42.42.5(pid=27546): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27546)] 08:48:26.385607 run osmo-stp_10.42.42.5(pid=27546): stdout: | (launched: 2022-12-13_08:48:24.996631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:26.518089 run osmo-stp_10.42.42.5(pid=27546): stderr: | 20221213084825187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084825187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084825187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084825188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084825190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084825190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084825190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:26.651496 run osmo-stp_10.42.42.5(pid=27546): stdout: | (launched: 2022-12-13_08:48:24.996631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:26.778766 run osmo-stp_10.42.42.5(pid=27546): stderr: | 20221213084825187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084825187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084825187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084825188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084825190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084825190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084825190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:26.929770 run patchelf(pid=27549): Terminating (SIGINT) 08:48:27.102966 run patchelf(pid=27549): Terminated: ok {rc=0} 08:48:27.228293 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27546): Process ended prematurely: osmo-stp_10.42.42.5(pid=27546) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27546)] [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 08:48:27.237832 tst ping.py:22: Test FAILED (6.4 sec) 08:48:27.265438 run osmo-hlr_10.42.42.2(pid=27543): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27543)] 08:48:27.315163 run osmo-hlr_10.42.42.2(pid=27543): stdout: | (launched: 2022-12-13_08:48:24.040035) 08:48:27.366613 run osmo-hlr_10.42.42.2(pid=27543): stderr: | 20221213084824237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084824237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084824237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084824237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084824237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084824238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084824250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084824258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084824258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084824258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:27.418388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27542): Terminating (SIGTERM) 08:48:27.459802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27545): Terminating (SIGTERM) 08:48:27.501381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27548): Terminating (SIGTERM) 08:48:27.543542 --- ParallelTerminationStrategy: PID 27542 died... 08:48:27.564120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27542): Terminated: ok {rc=0} 08:48:27.611350 --- ParallelTerminationStrategy: PID 27545 died... 08:48:27.631376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27545): Terminated: ok {rc=0} 08:48:27.677781 --- ParallelTerminationStrategy: PID 27548 died... 08:48:27.697523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27548): Terminated: ok {rc=0} 08:48:27.784210 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:48:28.871995 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:28.883797 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:48:28.921962 tst ping_idle_ping.py: using LAC 32813 08:48:29.043894 tst ping_idle_ping.py: using RAC 173 08:48:29.165536 tst ping_idle_ping.py: using CellId 32813 08:48:29.288796 tst ping_idle_ping.py: using BVCI 32814 08:48:29.401612 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:29.412911 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:29.424195 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:29.435543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:29.446667 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:29.457816 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:29.469106 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:29.480656 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:29.595162 tst ping_idle_ping.py:24: start network... 08:48:29.788721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:30.239163 run create_hlr_db(pid=27550): Launched 08:48:30.350428 bus /gobi_6: Setting Powered False 08:48:31.417283 run create_hlr_db(pid=27550): Terminated: ok {rc=0} 08:48:31.877750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27552): Launched 08:48:32.209804 run osmo-hlr_10.42.42.2(pid=27553): Launched 08:48:32.408907 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:32.907093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27555): Launched 08:48:33.196666 run osmo-stp_10.42.42.5(pid=27556): Launched 08:48:33.307510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:33.810702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27558): Launched 08:48:33.921943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:34.166317 run patchelf(pid=27559): Launched 08:48:34.328222 run osmo-stp_10.42.42.5(pid=27556): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27556)] 08:48:34.451716 run osmo-stp_10.42.42.5(pid=27556): stdout: | (launched: 2022-12-13_08:48:33.143748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:34.576400 run osmo-stp_10.42.42.5(pid=27556): stderr: | 20221213084833315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084833315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084833315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084833316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084833316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084833316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084833316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:34.701445 run osmo-stp_10.42.42.5(pid=27556): stdout: | (launched: 2022-12-13_08:48:33.143748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:34.821264 run osmo-stp_10.42.42.5(pid=27556): stderr: | 20221213084833315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084833315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084833315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084833316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084833316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084833316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084833316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:34.962875 run patchelf(pid=27559): Terminating (SIGINT) 08:48:35.126895 run patchelf(pid=27559): Terminated: ok {rc=0} 08:48:35.245284 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27556): Process ended prematurely: osmo-stp_10.42.42.5(pid=27556) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27556)] [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 08:48:35.254056 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:48:35.280392 run osmo-hlr_10.42.42.2(pid=27553): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27553)] 08:48:35.328486 run osmo-hlr_10.42.42.2(pid=27553): stdout: | (launched: 2022-12-13_08:48:32.145350) 08:48:35.377962 run osmo-hlr_10.42.42.2(pid=27553): stderr: | 20221213084832336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084832336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084832336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084832336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084832336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084832336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084832349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084832357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084832358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084832358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:35.427768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27552): Terminating (SIGTERM) 08:48:35.467887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27555): Terminating (SIGTERM) 08:48:35.507920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27558): Terminating (SIGTERM) 08:48:35.548245 --- ParallelTerminationStrategy: PID 27552 died... 08:48:35.567781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27552): Terminated: ok {rc=0} 08:48:35.612054 --- ParallelTerminationStrategy: PID 27555 died... 08:48:35.630932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27555): Terminated: ok {rc=0} 08:48:35.675183 --- ParallelTerminationStrategy: PID 27558 died... 08:48:35.694527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27558): Terminated: ok {rc=0} 08:48:35.780241 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:48:37.066704 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:37.072467 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:48:37.092433 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:48:37.130836 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:48:37.218320 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:48:37.239337 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:48:37.278750 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:48:37.865571 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:48:37.917784 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:37.929250 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:48:37.986285 tst cs_paging_gprs_active.py: using LAC 32814 08:48:38.109756 tst cs_paging_gprs_active.py: using RAC 174 08:48:38.235235 tst cs_paging_gprs_active.py: using CellId 32814 08:48:38.352834 tst cs_paging_gprs_active.py: using BVCI 32815 08:48:38.460025 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.471079 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.481816 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.492439 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.503206 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.514641 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.525782 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.536547 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:38.547584 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:48:38.662637 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:48:38.778757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:48:38.977210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:39.273503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Launched 08:48:39.529960 run iperf3-srv_10.42.42.10(pid=27564): Launched 08:48:39.640737 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:48:39.838688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:40.134074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Launched 08:48:40.389700 run iperf3-srv_10.42.42.10(pid=27566): Launched 08:48:40.500460 tst cs_paging_gprs_active.py:38: start network... 08:48:40.699293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:41.155478 run create_hlr_db(pid=27567): Launched 08:48:41.267135 bus /gobi_6: Setting Powered False 08:48:42.326530 run create_hlr_db(pid=27567): Terminated: ok {rc=0} 08:48:42.737491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27569): Launched 08:48:43.032258 run osmo-hlr_10.42.42.2(pid=27570): Launched 08:48:43.146098 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:43.669146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27572): Launched 08:48:43.963949 run osmo-stp_10.42.42.5(pid=27573): Launched 08:48:44.077611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:44.585530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27575): Launched 08:48:44.707249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:44.973331 run patchelf(pid=27576): Launched 08:48:45.148468 run osmo-stp_10.42.42.5(pid=27573): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27573)] 08:48:45.282164 run osmo-stp_10.42.42.5(pid=27573): stdout: | (launched: 2022-12-13_08:48:43.910721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:45.417881 run osmo-stp_10.42.42.5(pid=27573): stderr: | 20221213084844080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084844080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084844080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084844080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084844081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084844081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084844081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:45.553628 run osmo-stp_10.42.42.5(pid=27573): stdout: | (launched: 2022-12-13_08:48:43.910721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:45.683760 run osmo-stp_10.42.42.5(pid=27573): stderr: | 20221213084844080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084844080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084844080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084844080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084844081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084844081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084844081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:45.837990 run patchelf(pid=27576): Terminating (SIGINT) 08:48:46.031588 run patchelf(pid=27576): Terminated: ok {rc=0} 08:48:46.159219 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27573): Process ended prematurely: osmo-stp_10.42.42.5(pid=27573) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27573)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:48:46.169765 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 08:48:46.198063 run osmo-hlr_10.42.42.2(pid=27570): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27570)] 08:48:46.250233 run osmo-hlr_10.42.42.2(pid=27570): stdout: | (launched: 2022-12-13_08:48:42.979042) 08:48:46.304169 run osmo-hlr_10.42.42.2(pid=27570): stderr: | 20221213084843155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084843155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084843156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084843156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084843156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084843156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084843167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084843176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084843176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084843176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:46.356318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Terminating (SIGTERM) 08:48:46.399182 run iperf3-srv_10.42.42.10(pid=27564): Terminating (SIGTERM) 08:48:46.442682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Terminating (SIGTERM) 08:48:46.486374 run iperf3-srv_10.42.42.10(pid=27566): Terminating (SIGTERM) 08:48:46.530206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27569): Terminating (SIGTERM) 08:48:46.573464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27572): Terminating (SIGTERM) 08:48:46.616026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27575): Terminating (SIGTERM) 08:48:46.659840 --- ParallelTerminationStrategy: PID 27563 died... 08:48:46.682144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27563): Terminated: ok {rc=0} 08:48:46.728820 --- ParallelTerminationStrategy: PID 27564 died... 08:48:46.749650 run iperf3-srv_10.42.42.10(pid=27564): Terminated {rc=256} 08:48:46.795954 --- ParallelTerminationStrategy: PID 27565 died... 08:48:46.816669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27565): Terminated: ok {rc=0} 08:48:46.863409 --- ParallelTerminationStrategy: PID 27566 died... 08:48:46.885144 run iperf3-srv_10.42.42.10(pid=27566): Terminated {rc=256} 08:48:46.931390 --- ParallelTerminationStrategy: PID 27569 died... 08:48:46.952416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27569): Terminated: ok {rc=0} 08:48:46.998738 --- ParallelTerminationStrategy: PID 27572 died... 08:48:47.019783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27572): Terminated: ok {rc=0} 08:48:47.066269 --- ParallelTerminationStrategy: PID 27575 died... 08:48:47.088218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27575): Terminated: ok {rc=0} 08:48:47.178483 bus /gobi_0: Setting Powered False 08:48:48.277141 bus /gobi_0: Setting Powered False 08:48:49.392029 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:48:50.538261 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:50.550136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:48:50.610805 tst iperf3.py: using LAC 32815 08:48:50.734417 tst iperf3.py: using RAC 175 08:48:50.866335 tst iperf3.py: using CellId 32815 08:48:51.000779 tst iperf3.py: using BVCI 32816 08:48:51.117589 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.128801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.139689 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.150662 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.161504 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.172634 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.183772 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.194642 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:51.205698 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:48:51.323360 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:48:51.535613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:51.851306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27577): Launched 08:48:52.124026 run iperf3-srv_10.42.42.10(pid=27578): Launched 08:48:52.242110 tst iperf3.py:8: start network... 08:48:52.454634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:52.940898 run create_hlr_db(pid=27579): Launched 08:48:53.068512 bus /gobi_6: Setting Powered False 08:48:54.127180 run create_hlr_db(pid=27579): Terminated: ok {rc=0} 08:48:54.563268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27581): Launched 08:48:54.876825 run osmo-hlr_10.42.42.2(pid=27582): Launched 08:48:54.996735 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:55.538312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27584): Launched 08:48:55.852381 run osmo-stp_10.42.42.5(pid=27585): Launched 08:48:55.972340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:56.514936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27587): Launched 08:48:56.635702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:56.901175 run patchelf(pid=27588): Launched 08:48:57.075948 run osmo-stp_10.42.42.5(pid=27585): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27585)] 08:48:57.209362 run osmo-stp_10.42.42.5(pid=27585): stdout: | (launched: 2022-12-13_08:48:55.795318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:57.344510 run osmo-stp_10.42.42.5(pid=27585): stderr: | 20221213084855987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084855988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084855988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084855988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084855989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084855989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084855989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:57.479442 run osmo-stp_10.42.42.5(pid=27585): stdout: | (launched: 2022-12-13_08:48:55.795318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:57.609527 run osmo-stp_10.42.42.5(pid=27585): stderr: | 20221213084855987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084855988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084855988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084855988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084855989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084855989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084855989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:57.762596 run patchelf(pid=27588): Terminating (SIGINT) 08:48:57.940159 run patchelf(pid=27588): Terminated: ok {rc=0} 08:48:58.067968 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27585): Process ended prematurely: osmo-stp_10.42.42.5(pid=27585) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27585)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 08:48:58.078674 tst iperf3.py:8: Test FAILED (7.6 sec) 08:48:58.106800 run osmo-hlr_10.42.42.2(pid=27582): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27582)] 08:48:58.156618 run osmo-hlr_10.42.42.2(pid=27582): stdout: | (launched: 2022-12-13_08:48:54.820462) 08:48:58.208318 run osmo-hlr_10.42.42.2(pid=27582): stderr: | 20221213084855018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084855018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084855018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084855018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084855018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084855018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084855031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084855041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084855042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084855042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:58.260173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27577): Terminating (SIGTERM) 08:48:58.301739 run iperf3-srv_10.42.42.10(pid=27578): Terminating (SIGTERM) 08:48:58.343496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27581): Terminating (SIGTERM) 08:48:58.385215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27584): Terminating (SIGTERM) 08:48:58.426602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27587): Terminating (SIGTERM) 08:48:58.468307 --- ParallelTerminationStrategy: PID 27577 died... 08:48:58.488196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27577): Terminated: ok {rc=0} 08:48:58.534450 --- ParallelTerminationStrategy: PID 27578 died... 08:48:58.553795 run iperf3-srv_10.42.42.10(pid=27578): Terminated {rc=256} 08:48:58.600031 --- ParallelTerminationStrategy: PID 27581 died... 08:48:58.619512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27581): Terminated: ok {rc=0} 08:48:58.665464 --- ParallelTerminationStrategy: PID 27584 died... 08:48:58.685053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27584): Terminated: ok {rc=0} 08:48:58.730960 --- ParallelTerminationStrategy: PID 27587 died... 08:48:58.750513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27587): Terminated: ok {rc=0} 08:48:58.837654 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:48:59.981341 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:59.992406 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:49:00.049302 tst iperf3m4.py: using LAC 32816 08:49:00.164577 tst iperf3m4.py: using RAC 176 08:49:00.279897 tst iperf3m4.py: using CellId 32816 08:49:00.395085 tst iperf3m4.py: using BVCI 32817 08:49:00.501541 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.512359 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.522929 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.533433 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.544118 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.554857 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.566501 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.577341 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:00.588268 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:00.708403 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:00.826156 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:00.953148 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:01.086942 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:49:01.297640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:01.615272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27589): Launched 08:49:01.888885 run iperf3-srv_10.42.42.10(pid=27590): Launched 08:49:02.016583 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:49:02.221510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:02.521827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27591): Launched 08:49:02.797077 run iperf3-srv_10.42.42.10(pid=27592): Launched 08:49:02.915637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:49:03.128441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:03.445883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27593): Launched 08:49:03.720930 run iperf3-srv_10.42.42.10(pid=27594): Launched 08:49:03.839824 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:49:04.053971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:04.371143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27595): Launched 08:49:04.646222 run iperf3-srv_10.42.42.10(pid=27596): Launched 08:49:04.764888 tst iperf3m4.py:8: start network... 08:49:04.978604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:05.468165 run create_hlr_db(pid=27597): Launched 08:49:05.597048 bus /gobi_6: Setting Powered False 08:49:06.658668 run create_hlr_db(pid=27597): Terminated: ok {rc=0} 08:49:07.080844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27599): Launched 08:49:07.376523 run osmo-hlr_10.42.42.2(pid=27600): Launched 08:49:07.490275 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:08.013583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27602): Launched 08:49:08.307726 run osmo-stp_10.42.42.5(pid=27603): Launched 08:49:08.420145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:08.933304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27605): Launched 08:49:09.046032 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:09.294501 run patchelf(pid=27606): Launched 08:49:09.458322 run osmo-stp_10.42.42.5(pid=27603): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27603)] 08:49:09.583579 run osmo-stp_10.42.42.5(pid=27603): stdout: | (launched: 2022-12-13_08:49:08.254466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:09.710234 run osmo-stp_10.42.42.5(pid=27603): stderr: | 20221213084908423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084908423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084908423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084908424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084908424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084908424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084908424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:09.836625 run osmo-stp_10.42.42.5(pid=27603): stdout: | (launched: 2022-12-13_08:49:08.254466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:09.957973 run osmo-stp_10.42.42.5(pid=27603): stderr: | 20221213084908423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084908423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084908423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084908424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084908424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084908424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084908424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:10.101618 run patchelf(pid=27606): Terminating (SIGINT) 08:49:10.267305 run patchelf(pid=27606): Terminated: ok {rc=0} 08:49:10.387040 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27603): Process ended prematurely: osmo-stp_10.42.42.5(pid=27603) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27603)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:49:10.396267 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:49:10.423307 run osmo-hlr_10.42.42.2(pid=27600): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27600)] 08:49:10.472050 run osmo-hlr_10.42.42.2(pid=27600): stdout: | (launched: 2022-12-13_08:49:07.322787) 08:49:10.521468 run osmo-hlr_10.42.42.2(pid=27600): stderr: | 20221213084907497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084907497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084907497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084907497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084907497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084907498 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084907509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084907518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084907518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084907518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:10.571044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27589): Terminating (SIGTERM) 08:49:10.610952 run iperf3-srv_10.42.42.10(pid=27590): Terminating (SIGTERM) 08:49:10.650680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27591): Terminating (SIGTERM) 08:49:10.690599 run iperf3-srv_10.42.42.10(pid=27592): Terminating (SIGTERM) 08:49:10.730201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27593): Terminating (SIGTERM) 08:49:10.770070 run iperf3-srv_10.42.42.10(pid=27594): Terminating (SIGTERM) 08:49:10.809701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27595): Terminating (SIGTERM) 08:49:10.849492 run iperf3-srv_10.42.42.10(pid=27596): Terminating (SIGTERM) 08:49:10.889086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27599): Terminating (SIGTERM) 08:49:10.928750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27602): Terminating (SIGTERM) 08:49:10.968409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27605): Terminating (SIGTERM) 08:49:11.008286 --- ParallelTerminationStrategy: PID 27589 died... 08:49:11.027609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27589): Terminated: ok {rc=0} 08:49:11.071534 --- ParallelTerminationStrategy: PID 27590 died... 08:49:11.090141 run iperf3-srv_10.42.42.10(pid=27590): Terminated {rc=256} 08:49:11.133979 --- ParallelTerminationStrategy: PID 27591 died... 08:49:11.152651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27591): Terminated: ok {rc=0} 08:49:11.196660 --- ParallelTerminationStrategy: PID 27592 died... 08:49:11.215448 run iperf3-srv_10.42.42.10(pid=27592): Terminated {rc=256} 08:49:11.259143 --- ParallelTerminationStrategy: PID 27593 died... 08:49:11.277880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27593): Terminated: ok {rc=0} 08:49:11.321544 --- ParallelTerminationStrategy: PID 27594 died... 08:49:11.340169 run iperf3-srv_10.42.42.10(pid=27594): Terminated {rc=256} 08:49:11.383883 --- ParallelTerminationStrategy: PID 27595 died... 08:49:11.402542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27595): Terminated: ok {rc=0} 08:49:11.446168 --- ParallelTerminationStrategy: PID 27596 died... 08:49:11.464789 run iperf3-srv_10.42.42.10(pid=27596): Terminated {rc=256} 08:49:11.508234 --- ParallelTerminationStrategy: PID 27599 died... 08:49:11.526881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27599): Terminated: ok {rc=0} 08:49:11.570492 --- ParallelTerminationStrategy: PID 27602 died... 08:49:11.589390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27602): Terminated: ok {rc=0} 08:49:11.632776 --- ParallelTerminationStrategy: PID 27605 died... 08:49:11.651469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27605): Terminated: ok {rc=0} 08:49:11.736455 bus /gobi_4: Setting Powered False 08:49:12.834472 bus /gobi_4: Setting Powered False 08:49:13.948391 bus /gobi_1: Setting Powered False 08:49:15.047330 bus /gobi_1: Setting Powered False 08:49:16.162995 bus /gobi_0: Setting Powered False 08:49:17.272761 bus /gobi_0: Setting Powered False 08:49:18.389309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:49:19.489082 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:19.500465 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:49:19.557679 tst ping.py: using LAC 32817 08:49:19.682722 tst ping.py: using RAC 177 08:49:19.812139 tst ping.py: using CellId 32817 08:49:19.927593 tst ping.py: using BVCI 32818 08:49:20.033098 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:20.044060 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:20.054779 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:20.065255 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:20.076032 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:20.087427 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:20.099067 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:20.110073 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:20.227935 tst ping.py:19: start network... 08:49:20.437876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:20.918258 run create_hlr_db(pid=27607): Launched 08:49:21.045072 bus /gobi_6: Setting Powered False 08:49:22.107177 run create_hlr_db(pid=27607): Terminated: ok {rc=0} 08:49:22.539735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27609): Launched 08:49:22.849130 run osmo-hlr_10.42.42.2(pid=27610): Launched 08:49:22.967082 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:23.505877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27612): Launched 08:49:23.815396 run osmo-stp_10.42.42.5(pid=27613): Launched 08:49:23.933182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:24.469077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27615): Launched 08:49:24.587748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:24.849842 run patchelf(pid=27616): Launched 08:49:25.022176 run osmo-stp_10.42.42.5(pid=27613): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27613)] 08:49:25.154093 run osmo-stp_10.42.42.5(pid=27613): stdout: | (launched: 2022-12-13_08:49:23.759347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:25.287394 run osmo-stp_10.42.42.5(pid=27613): stderr: | 20221213084923949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084923949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084923949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084923950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084923952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084923952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084923952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:25.420839 run osmo-stp_10.42.42.5(pid=27613): stdout: | (launched: 2022-12-13_08:49:23.759347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:25.548592 run osmo-stp_10.42.42.5(pid=27613): stderr: | 20221213084923949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084923949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084923949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084923950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084923952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084923952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084923952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:25.700592 run patchelf(pid=27616): Terminating (SIGINT) 08:49:25.874615 run patchelf(pid=27616): Terminated: ok {rc=0} 08:49:26.000226 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27613): Process ended prematurely: osmo-stp_10.42.42.5(pid=27613) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27613)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 08:49:26.009775 tst ping.py:22: Test FAILED (6.5 sec) 08:49:26.037797 run osmo-hlr_10.42.42.2(pid=27610): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27610)] 08:49:26.088108 run osmo-hlr_10.42.42.2(pid=27610): stdout: | (launched: 2022-12-13_08:49:22.793377) 08:49:26.140088 run osmo-hlr_10.42.42.2(pid=27610): stderr: | 20221213084922990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084922990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084922990 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084922990 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084922990 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084922990 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084923003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084923011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084923011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084923011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:26.192217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27609): Terminating (SIGTERM) 08:49:26.234109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27612): Terminating (SIGTERM) 08:49:26.275930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27615): Terminating (SIGTERM) 08:49:26.318204 --- ParallelTerminationStrategy: PID 27609 died... 08:49:26.338387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27609): Terminated: ok {rc=0} 08:49:26.384675 --- ParallelTerminationStrategy: PID 27612 died... 08:49:26.404037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27612): Terminated: ok {rc=0} 08:49:26.449968 --- ParallelTerminationStrategy: PID 27615 died... 08:49:26.469576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27615): Terminated: ok {rc=0} 08:49:26.556434 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:49:27.644664 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:27.656650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:49:27.715612 tst ping_idle_ping.py: using LAC 32818 08:49:27.838624 tst ping_idle_ping.py: using RAC 178 08:49:27.954413 tst ping_idle_ping.py: using CellId 32818 08:49:28.068644 tst ping_idle_ping.py: using BVCI 32819 08:49:28.174039 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:28.184924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:28.195504 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:28.206052 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:28.216620 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:28.228097 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:28.239703 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:28.250586 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:28.363562 tst ping_idle_ping.py:24: start network... 08:49:28.558148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:29.010548 run create_hlr_db(pid=27617): Launched 08:49:29.120902 bus /gobi_6: Setting Powered False 08:49:30.179483 run create_hlr_db(pid=27617): Terminated: ok {rc=0} 08:49:30.584889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27619): Launched 08:49:30.875528 run osmo-hlr_10.42.42.2(pid=27620): Launched 08:49:30.997437 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:31.639309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27622): Launched 08:49:31.950515 run osmo-stp_10.42.42.5(pid=27623): Launched 08:49:32.095395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:32.808805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27625): Launched 08:49:32.927528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:33.190127 run patchelf(pid=27626): Launched 08:49:33.363176 run osmo-stp_10.42.42.5(pid=27623): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27623)] 08:49:33.495915 run osmo-stp_10.42.42.5(pid=27623): stdout: | (launched: 2022-12-13_08:49:31.888369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:33.630349 run osmo-stp_10.42.42.5(pid=27623): stderr: | 20221213084932247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084932247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084932249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084932249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084932251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084932251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084932251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:33.764856 run osmo-stp_10.42.42.5(pid=27623): stdout: | (launched: 2022-12-13_08:49:31.888369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:33.893851 run osmo-stp_10.42.42.5(pid=27623): stderr: | 20221213084932247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084932247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084932249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084932249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084932251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084932251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084932251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:34.045798 run patchelf(pid=27626): Terminating (SIGINT) 08:49:34.220764 run patchelf(pid=27626): Terminated: ok {rc=0} 08:49:34.346716 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27623): Process ended prematurely: osmo-stp_10.42.42.5(pid=27623) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27623)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:49:34.355991 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:49:34.383694 run osmo-hlr_10.42.42.2(pid=27620): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27620)] 08:49:34.433692 run osmo-hlr_10.42.42.2(pid=27620): stdout: | (launched: 2022-12-13_08:49:30.822011) 08:49:34.485406 run osmo-hlr_10.42.42.2(pid=27620): stderr: | 20221213084931117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084931117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084931117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084931117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084931117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084931117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084931133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084931150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084931150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084931150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:34.537422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27619): Terminating (SIGTERM) 08:49:34.579428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27622): Terminating (SIGTERM) 08:49:34.621407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27625): Terminating (SIGTERM) 08:49:34.663249 --- ParallelTerminationStrategy: PID 27619 died... 08:49:34.683111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27619): Terminated: ok {rc=0} 08:49:34.728803 --- ParallelTerminationStrategy: PID 27622 died... 08:49:34.748257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27622): Terminated: ok {rc=0} 08:49:34.795189 --- ParallelTerminationStrategy: PID 27625 died... 08:49:34.814843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27625): Terminated: ok {rc=0} 08:49:34.902031 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:49:36.195051 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:49:36.201337 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:49:36.222097 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:49:36.262585 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:49:36.351150 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:49:36.371924 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:49:36.411309 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:49:37.006160 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:49:37.057600 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.068764 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:49:37.126912 tst cs_paging_gprs_active.py: using LAC 32819 08:49:37.246266 tst cs_paging_gprs_active.py: using RAC 179 08:49:37.365238 tst cs_paging_gprs_active.py: using CellId 32819 08:49:37.481287 tst cs_paging_gprs_active.py: using BVCI 32820 08:49:37.588710 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.599768 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.610485 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.621133 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.631781 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.643129 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.654526 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.665414 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:37.676351 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:49:37.795895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:49:37.910669 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:49:38.108820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:38.404035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27630): Launched 08:49:38.660107 run iperf3-srv_10.42.42.10(pid=27631): Launched 08:49:38.770788 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:49:38.968188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:39.264474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27632): Launched 08:49:39.520071 run iperf3-srv_10.42.42.10(pid=27633): Launched 08:49:39.630668 tst cs_paging_gprs_active.py:38: start network... 08:49:39.828392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:40.285021 run create_hlr_db(pid=27634): Launched 08:49:40.397355 bus /gobi_6: Setting Powered False 08:49:41.456421 run create_hlr_db(pid=27634): Terminated: ok {rc=0} 08:49:41.888458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27636): Launched 08:49:42.204203 run osmo-hlr_10.42.42.2(pid=27637): Launched 08:49:42.325936 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:42.869790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27639): Launched 08:49:43.184406 run osmo-stp_10.42.42.5(pid=27640): Launched 08:49:43.305494 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:43.851695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27642): Launched 08:49:43.972335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:44.239595 run patchelf(pid=27643): Launched 08:49:44.415038 run osmo-stp_10.42.42.5(pid=27640): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27640)] 08:49:44.548608 run osmo-stp_10.42.42.5(pid=27640): stdout: | (launched: 2022-12-13_08:49:43.127667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:44.684780 run osmo-stp_10.42.42.5(pid=27640): stderr: | 20221213084943319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084943319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084943319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084943320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084943322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084943322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084943322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:44.820436 run osmo-stp_10.42.42.5(pid=27640): stdout: | (launched: 2022-12-13_08:49:43.127667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:44.950009 run osmo-stp_10.42.42.5(pid=27640): stderr: | 20221213084943319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084943319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084943319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084943320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084943322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084943322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084943322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:45.103792 run patchelf(pid=27643): Terminating (SIGINT) 08:49:45.280538 run patchelf(pid=27643): Terminated: ok {rc=0} 08:49:45.408435 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27640): Process ended prematurely: osmo-stp_10.42.42.5(pid=27640) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27640)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:49:45.418617 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 08:49:45.446303 run osmo-hlr_10.42.42.2(pid=27637): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27637)] 08:49:45.495449 run osmo-hlr_10.42.42.2(pid=27637): stdout: | (launched: 2022-12-13_08:49:42.146839) 08:49:45.546479 run osmo-hlr_10.42.42.2(pid=27637): stderr: | 20221213084942344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084942344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084942344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084942345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084942345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084942345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084942356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084942364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084942365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084942365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:45.597849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27630): Terminating (SIGTERM) 08:49:45.639311 run iperf3-srv_10.42.42.10(pid=27631): Terminating (SIGTERM) 08:49:45.680649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27632): Terminating (SIGTERM) 08:49:45.722152 run iperf3-srv_10.42.42.10(pid=27633): Terminating (SIGTERM) 08:49:45.763562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27636): Terminating (SIGTERM) 08:49:45.805299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27639): Terminating (SIGTERM) 08:49:45.846749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27642): Terminating (SIGTERM) 08:49:45.888020 --- ParallelTerminationStrategy: PID 27630 died... 08:49:45.907977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27630): Terminated: ok {rc=0} 08:49:45.958082 --- ParallelTerminationStrategy: PID 27631 died... 08:49:45.979188 run iperf3-srv_10.42.42.10(pid=27631): Terminated {rc=256} 08:49:46.025179 --- ParallelTerminationStrategy: PID 27632 died... 08:49:46.045046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27632): Terminated: ok {rc=0} 08:49:46.091257 --- ParallelTerminationStrategy: PID 27633 died... 08:49:46.111001 run iperf3-srv_10.42.42.10(pid=27633): Terminated {rc=256} 08:49:46.156999 --- ParallelTerminationStrategy: PID 27636 died... 08:49:46.176895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27636): Terminated: ok {rc=0} 08:49:46.223583 --- ParallelTerminationStrategy: PID 27639 died... 08:49:46.243363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27639): Terminated: ok {rc=0} 08:49:46.289554 --- ParallelTerminationStrategy: PID 27642 died... 08:49:46.309533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27642): Terminated: ok {rc=0} 08:49:46.397445 bus /gobi_0: Setting Powered False 08:49:47.494501 bus /gobi_0: Setting Powered False 08:49:48.607815 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:49:49.752680 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:49.764161 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:49:49.824271 tst iperf3.py: using LAC 32820 08:49:49.950396 tst iperf3.py: using RAC 180 08:49:50.074163 tst iperf3.py: using CellId 32820 08:49:50.203569 tst iperf3.py: using BVCI 32821 08:49:50.313715 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.325260 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.336289 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.347366 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.358894 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.370057 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.381109 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.392176 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:50.403263 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:49:50.521548 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:49:50.735651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:51.050862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27644): Launched 08:49:51.323762 run iperf3-srv_10.42.42.10(pid=27645): Launched 08:49:51.441830 tst iperf3.py:8: start network... 08:49:51.654462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:52.142026 run create_hlr_db(pid=27646): Launched 08:49:52.270849 bus /gobi_6: Setting Powered False 08:49:53.330469 run create_hlr_db(pid=27646): Terminated: ok {rc=0} 08:49:53.766076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27648): Launched 08:49:54.080908 run osmo-hlr_10.42.42.2(pid=27649): Launched 08:49:54.201159 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:54.750145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27651): Launched 08:49:55.063562 run osmo-stp_10.42.42.5(pid=27652): Launched 08:49:55.183260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:55.726163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27654): Launched 08:49:55.845755 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:56.111241 run patchelf(pid=27655): Launched 08:49:56.286069 run osmo-stp_10.42.42.5(pid=27652): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27652)] 08:49:56.419663 run osmo-stp_10.42.42.5(pid=27652): stdout: | (launched: 2022-12-13_08:49:55.006947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:56.554733 run osmo-stp_10.42.42.5(pid=27652): stderr: | 20221213084955199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084955199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084955200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084955200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084955200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084955201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084955201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:56.690893 run osmo-stp_10.42.42.5(pid=27652): stdout: | (launched: 2022-12-13_08:49:55.006947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:56.820050 run osmo-stp_10.42.42.5(pid=27652): stderr: | 20221213084955199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213084955199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213084955200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213084955200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213084955200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213084955201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213084955201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:56.973340 run patchelf(pid=27655): Terminating (SIGINT) 08:49:57.149733 run patchelf(pid=27655): Terminated: ok {rc=0} 08:49:57.277156 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27652): Process ended prematurely: osmo-stp_10.42.42.5(pid=27652) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27652)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 08:49:57.287254 tst iperf3.py:8: Test FAILED (7.6 sec) 08:49:57.314997 run osmo-hlr_10.42.42.2(pid=27649): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27649)] 08:49:57.364155 run osmo-hlr_10.42.42.2(pid=27649): stdout: | (launched: 2022-12-13_08:49:54.024137) 08:49:57.415209 run osmo-hlr_10.42.42.2(pid=27649): stderr: | 20221213084954223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213084954223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213084954223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213084954223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213084954223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213084954223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213084954236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213084954245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213084954245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213084954245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:57.466739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27644): Terminating (SIGTERM) 08:49:57.510027 run iperf3-srv_10.42.42.10(pid=27645): Terminating (SIGTERM) 08:49:57.551450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27648): Terminating (SIGTERM) 08:49:57.592923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27651): Terminating (SIGTERM) 08:49:57.634560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27654): Terminating (SIGTERM) 08:49:57.676510 --- ParallelTerminationStrategy: PID 27644 died... 08:49:57.696419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27644): Terminated: ok {rc=0} 08:49:57.742550 --- ParallelTerminationStrategy: PID 27645 died... 08:49:57.762198 run iperf3-srv_10.42.42.10(pid=27645): Terminated {rc=256} 08:49:57.807686 --- ParallelTerminationStrategy: PID 27648 died... 08:49:57.826918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27648): Terminated: ok {rc=0} 08:49:57.872103 --- ParallelTerminationStrategy: PID 27651 died... 08:49:57.891216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27651): Terminated: ok {rc=0} 08:49:57.936684 --- ParallelTerminationStrategy: PID 27654 died... 08:49:57.956186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27654): Terminated: ok {rc=0} 08:49:58.043096 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:49:59.190955 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.202725 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:49:59.261497 tst iperf3m4.py: using LAC 32821 08:49:59.380204 tst iperf3m4.py: using RAC 181 08:49:59.496335 tst iperf3m4.py: using CellId 32821 08:49:59.613034 tst iperf3m4.py: using BVCI 32822 08:49:59.722308 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.733474 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.744191 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.755002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.766243 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.777537 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.788798 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.799921 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:59.811237 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:49:59.931173 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:00.050079 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:00.168446 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:00.288582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:50:00.503591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:00.821076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27656): Launched 08:50:01.150658 run iperf3-srv_10.42.42.10(pid=27657): Launched 08:50:01.319050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:50:01.619615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:02.028140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27662): Launched 08:50:02.368401 run iperf3-srv_10.42.42.10(pid=27669): Launched 08:50:02.498447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:50:02.704087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:03.003834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27670): Launched 08:50:03.259078 run iperf3-srv_10.42.42.10(pid=27671): Launched 08:50:03.369999 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:50:03.567024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:03.861511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27672): Launched 08:50:04.117283 run iperf3-srv_10.42.42.10(pid=27673): Launched 08:50:04.227747 tst iperf3m4.py:8: start network... 08:50:04.425206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:04.880455 run create_hlr_db(pid=27674): Launched 08:50:04.992808 bus /gobi_6: Setting Powered False 08:50:06.052513 run create_hlr_db(pid=27674): Terminated: ok {rc=0} 08:50:06.463477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27676): Launched 08:50:06.757157 run osmo-hlr_10.42.42.2(pid=27677): Launched 08:50:06.870539 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:07.394937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27679): Launched 08:50:07.690908 run osmo-stp_10.42.42.5(pid=27680): Launched 08:50:07.803577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:08.311123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27682): Launched 08:50:08.423890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:08.671777 run patchelf(pid=27683): Launched 08:50:08.835840 run osmo-stp_10.42.42.5(pid=27680): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27680)] 08:50:08.960361 run osmo-stp_10.42.42.5(pid=27680): stdout: | (launched: 2022-12-13_08:50:07.635360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:09.087367 run osmo-stp_10.42.42.5(pid=27680): stderr: | 20221213085007809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085007809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085007809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085007809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085007810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085007810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085007810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:09.213973 run osmo-stp_10.42.42.5(pid=27680): stdout: | (launched: 2022-12-13_08:50:07.635360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:09.335368 run osmo-stp_10.42.42.5(pid=27680): stderr: | 20221213085007809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085007809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085007809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085007809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085007810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085007810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085007810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:09.479326 run patchelf(pid=27683): Terminating (SIGINT) 08:50:09.644853 run patchelf(pid=27683): Terminated: ok {rc=0} 08:50:09.764358 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27680): Process ended prematurely: osmo-stp_10.42.42.5(pid=27680) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27680)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:50:09.773869 tst iperf3m4.py:8: Test FAILED (10.6 sec) 08:50:09.800825 run osmo-hlr_10.42.42.2(pid=27677): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27677)] 08:50:09.848896 run osmo-hlr_10.42.42.2(pid=27677): stdout: | (launched: 2022-12-13_08:50:06.703487) 08:50:09.898433 run osmo-hlr_10.42.42.2(pid=27677): stderr: | 20221213085006876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085006876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085006876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085006877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085006877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085006877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085006888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085006896 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085006897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085006897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:09.947972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27656): Terminating (SIGTERM) 08:50:09.987894 run iperf3-srv_10.42.42.10(pid=27657): Terminating (SIGTERM) 08:50:10.027664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27662): Terminating (SIGTERM) 08:50:10.067696 run iperf3-srv_10.42.42.10(pid=27669): Terminating (SIGTERM) 08:50:10.107618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27670): Terminating (SIGTERM) 08:50:10.147524 run iperf3-srv_10.42.42.10(pid=27671): Terminating (SIGTERM) 08:50:10.187080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27672): Terminating (SIGTERM) 08:50:10.227403 run iperf3-srv_10.42.42.10(pid=27673): Terminating (SIGTERM) 08:50:10.267152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27676): Terminating (SIGTERM) 08:50:10.307618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27679): Terminating (SIGTERM) 08:50:10.347479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27682): Terminating (SIGTERM) 08:50:10.387861 --- ParallelTerminationStrategy: PID 27656 died... 08:50:10.407484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27656): Terminated: ok {rc=0} 08:50:10.451591 --- ParallelTerminationStrategy: PID 27657 died... 08:50:10.470423 run iperf3-srv_10.42.42.10(pid=27657): Terminated {rc=256} 08:50:10.513805 --- ParallelTerminationStrategy: PID 27662 died... 08:50:10.532506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27662): Terminated: ok {rc=0} 08:50:10.576732 --- ParallelTerminationStrategy: PID 27669 died... 08:50:10.595336 run iperf3-srv_10.42.42.10(pid=27669): Terminated {rc=256} 08:50:10.639534 --- ParallelTerminationStrategy: PID 27670 died... 08:50:10.658228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27670): Terminated: ok {rc=0} 08:50:10.701690 --- ParallelTerminationStrategy: PID 27671 died... 08:50:10.720347 run iperf3-srv_10.42.42.10(pid=27671): Terminated {rc=256} 08:50:10.763807 --- ParallelTerminationStrategy: PID 27672 died... 08:50:10.782501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27672): Terminated: ok {rc=0} 08:50:10.826096 --- ParallelTerminationStrategy: PID 27673 died... 08:50:10.844843 run iperf3-srv_10.42.42.10(pid=27673): Terminated {rc=256} 08:50:10.888214 --- ParallelTerminationStrategy: PID 27676 died... 08:50:10.906968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27676): Terminated: ok {rc=0} 08:50:10.950684 --- ParallelTerminationStrategy: PID 27679 died... 08:50:10.969592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27679): Terminated: ok {rc=0} 08:50:11.013178 --- ParallelTerminationStrategy: PID 27682 died... 08:50:11.031898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27682): Terminated: ok {rc=0} 08:50:11.117614 bus /gobi_4: Setting Powered False 08:50:12.215144 bus /gobi_4: Setting Powered False 08:50:13.329570 bus /gobi_1: Setting Powered False 08:50:14.435314 bus /gobi_1: Setting Powered False 08:50:15.552619 bus /gobi_0: Setting Powered False 08:50:16.652027 bus /gobi_0: Setting Powered False 08:50:17.779600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:50:18.878156 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:18.889647 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:50:18.947559 tst ping.py: using LAC 32822 08:50:19.062715 tst ping.py: using RAC 182 08:50:19.177357 tst ping.py: using CellId 32822 08:50:19.291549 tst ping.py: using BVCI 32823 08:50:19.396738 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:19.407801 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:19.418558 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:19.429389 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:19.440439 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:19.451544 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:19.462825 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:19.474027 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:19.593506 tst ping.py:19: start network... 08:50:19.803427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:20.282178 run create_hlr_db(pid=28035): Launched 08:50:20.407799 bus /gobi_6: Setting Powered False 08:50:21.468765 run create_hlr_db(pid=28035): Terminated: ok {rc=0} 08:50:21.901048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28037): Launched 08:50:22.209271 run osmo-hlr_10.42.42.2(pid=28038): Launched 08:50:22.327771 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:22.868682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28040): Launched 08:50:23.177659 run osmo-stp_10.42.42.5(pid=28041): Launched 08:50:23.295655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:23.830366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28043): Launched 08:50:23.948348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:24.210437 run patchelf(pid=28044): Launched 08:50:24.373302 run osmo-stp_10.42.42.5(pid=28041): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28041)] 08:50:24.497522 run osmo-stp_10.42.42.5(pid=28041): stdout: | (launched: 2022-12-13_08:50:23.121807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:24.623586 run osmo-stp_10.42.42.5(pid=28041): stderr: | 20221213085023311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085023311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085023311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085023312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085023314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085023314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085023314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:24.749237 run osmo-stp_10.42.42.5(pid=28041): stdout: | (launched: 2022-12-13_08:50:23.121807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:24.869425 run osmo-stp_10.42.42.5(pid=28041): stderr: | 20221213085023311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085023311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085023311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085023312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085023314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085023314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085023314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:25.011556 run patchelf(pid=28044): Terminating (SIGINT) 08:50:25.174549 run patchelf(pid=28044): Terminated: ok {rc=0} 08:50:25.292352 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28041): Process ended prematurely: osmo-stp_10.42.42.5(pid=28041) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28041)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 08:50:25.301265 tst ping.py:22: Test FAILED (6.4 sec) 08:50:25.327785 run osmo-hlr_10.42.42.2(pid=28038): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28038)] 08:50:25.376383 run osmo-hlr_10.42.42.2(pid=28038): stdout: | (launched: 2022-12-13_08:50:22.153473) 08:50:25.426569 run osmo-hlr_10.42.42.2(pid=28038): stderr: | 20221213085022348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085022348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085022348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085022348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085022348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085022349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085022362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085022370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085022370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085022370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:25.477161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28037): Terminating (SIGTERM) 08:50:25.517557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28040): Terminating (SIGTERM) 08:50:25.558562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28043): Terminating (SIGTERM) 08:50:25.599540 --- ParallelTerminationStrategy: PID 28037 died... 08:50:25.619646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28037): Terminated: ok {rc=0} 08:50:25.664483 --- ParallelTerminationStrategy: PID 28040 died... 08:50:25.683785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28040): Terminated: ok {rc=0} 08:50:25.728399 --- ParallelTerminationStrategy: PID 28043 died... 08:50:25.747755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28043): Terminated: ok {rc=0} 08:50:25.834742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:50:26.920632 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:26.932111 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:50:26.990119 tst ping_idle_ping.py: using LAC 32823 08:50:27.106417 tst ping_idle_ping.py: using RAC 183 08:50:27.230675 tst ping_idle_ping.py: using CellId 32823 08:50:27.354381 tst ping_idle_ping.py: using BVCI 32824 08:50:27.462955 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:27.474066 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:27.484941 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:27.495701 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:27.507047 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:27.518305 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:27.529524 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:27.540255 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:27.659679 tst ping_idle_ping.py:24: start network... 08:50:27.869634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:28.359273 run create_hlr_db(pid=28045): Launched 08:50:28.485415 bus /gobi_6: Setting Powered False 08:50:29.547000 run create_hlr_db(pid=28045): Terminated: ok {rc=0} 08:50:29.986383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28218): Launched 08:50:30.306681 run osmo-hlr_10.42.42.2(pid=28224): Launched 08:50:30.513171 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:31.138710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28227): Launched 08:50:31.473722 run osmo-stp_10.42.42.5(pid=28228): Launched 08:50:31.706814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:32.519657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28230): Launched 08:50:32.663740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:32.975578 run patchelf(pid=28231): Launched 08:50:33.185594 run osmo-stp_10.42.42.5(pid=28228): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28228)] 08:50:33.335773 run osmo-stp_10.42.42.5(pid=28228): stdout: | (launched: 2022-12-13_08:50:31.398815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:33.465154 run osmo-stp_10.42.42.5(pid=28228): stderr: | 20221213085031773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085031773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085031774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085031774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085031775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085031775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085031775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:33.596368 run osmo-stp_10.42.42.5(pid=28228): stdout: | (launched: 2022-12-13_08:50:31.398815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:33.721285 run osmo-stp_10.42.42.5(pid=28228): stderr: | 20221213085031773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085031773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085031774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085031774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085031775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085031775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085031775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:33.866809 run patchelf(pid=28231): Terminating (SIGINT) 08:50:34.034851 run patchelf(pid=28231): Terminated: ok {rc=0} 08:50:34.157524 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28228): Process ended prematurely: osmo-stp_10.42.42.5(pid=28228) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28228)] [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:50:34.167379 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 08:50:34.195021 run osmo-hlr_10.42.42.2(pid=28224): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28224)] 08:50:34.248444 run osmo-hlr_10.42.42.2(pid=28224): stdout: | (launched: 2022-12-13_08:50:30.246966) 08:50:34.299338 run osmo-hlr_10.42.42.2(pid=28224): stderr: | 20221213085030454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085030454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085030454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085030454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085030454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085030454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085030468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085030481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085030482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085030482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:34.354375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28218): Terminating (SIGTERM) 08:50:34.395549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28227): Terminating (SIGTERM) 08:50:34.438652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28230): Terminating (SIGTERM) 08:50:34.481580 --- ParallelTerminationStrategy: PID 28218 died... 08:50:34.503813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28218): Terminated: ok {rc=0} 08:50:34.551621 --- ParallelTerminationStrategy: PID 28227 died... 08:50:34.572692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28227): Terminated: ok {rc=0} 08:50:34.619503 --- ParallelTerminationStrategy: PID 28230 died... 08:50:34.640214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28230): Terminated: ok {rc=0} 08:50:34.730039 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:50:36.017083 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:36.024330 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:50:36.045526 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:50:36.084356 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:50:36.140313 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:50:36.161875 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:50:36.200636 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:50:36.752337 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:50:36.757401 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:36.768279 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:50:36.823240 tst switch_tch_pdch.py: using LAC 32824 08:50:36.936080 tst switch_tch_pdch.py: using RAC 184 08:50:37.048636 tst switch_tch_pdch.py: using CellId 32824 08:50:37.161626 tst switch_tch_pdch.py: using BVCI 32825 08:50:37.275477 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:37.287337 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:37.298922 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:37.310598 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:37.322775 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:37.335033 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:37.347407 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:37.359564 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:37.475680 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:37.589511 tst switch_tch_pdch.py:51: start network... 08:50:37.783009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:38.231990 run create_hlr_db(pid=28236): Launched 08:50:38.343594 bus /gobi_6: Setting Powered False 08:50:39.401186 run create_hlr_db(pid=28236): Terminated: ok {rc=0} 08:50:39.825169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28238): Launched 08:50:40.132804 run osmo-hlr_10.42.42.2(pid=28239): Launched 08:50:40.251327 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:40.787148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28241): Launched 08:50:41.096051 run osmo-stp_10.42.42.5(pid=28242): Launched 08:50:41.214469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:41.752323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28244): Launched 08:50:41.871041 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:42.132162 run patchelf(pid=28245): Launched 08:50:42.303849 run osmo-stp_10.42.42.5(pid=28242): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28242)] 08:50:42.435186 run osmo-stp_10.42.42.5(pid=28242): stdout: | (launched: 2022-12-13_08:50:41.040265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:42.568015 run osmo-stp_10.42.42.5(pid=28242): stderr: | 20221213085041232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085041232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085041232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085041233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085041233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085041233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085041234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:42.701937 run osmo-stp_10.42.42.5(pid=28242): stdout: | (launched: 2022-12-13_08:50:41.040265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:42.829310 run osmo-stp_10.42.42.5(pid=28242): stderr: | 20221213085041232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085041232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085041232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085041233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085041233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085041233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085041234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:42.980022 run patchelf(pid=28245): Terminating (SIGINT) 08:50:43.152939 run patchelf(pid=28245): Terminated: ok {rc=0} 08:50:43.278029 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28242): Process ended prematurely: osmo-stp_10.42.42.5(pid=28242) [trial-2387↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28242)] [trial-2387↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:50:43.287198 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 08:50:43.314707 run osmo-hlr_10.42.42.2(pid=28239): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28239)] 08:50:43.364069 run osmo-hlr_10.42.42.2(pid=28239): stdout: | (launched: 2022-12-13_08:50:40.077527) 08:50:43.415210 run osmo-hlr_10.42.42.2(pid=28239): stderr: | 20221213085040271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085040272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085040272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085040272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085040272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085040272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085040291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085040302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085040302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085040302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:43.466752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28238): Terminating (SIGTERM) 08:50:43.507922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28241): Terminating (SIGTERM) 08:50:43.548816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28244): Terminating (SIGTERM) 08:50:43.590683 --- ParallelTerminationStrategy: PID 28238 died... 08:50:43.610622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28238): Terminated: ok {rc=0} 08:50:43.656436 --- ParallelTerminationStrategy: PID 28241 died... 08:50:43.675565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28241): Terminated: ok {rc=0} 08:50:43.721171 --- ParallelTerminationStrategy: PID 28244 died... 08:50:43.740438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28244): Terminated: ok {rc=0} 08:50:43.826941 bus /gobi_0: Setting Powered False 08:50:44.922827 bus /gobi_0: Setting Powered False 08:50:46.046066 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:50:47.291343 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:47.297592 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:50:47.318953 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:50:47.354624 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:50:47.408272 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:50:47.429482 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:50:47.464764 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:50:48.019517 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:50:48.025078 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.036322 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:50:48.093220 tst switch_tch_pdch.py: using LAC 32825 08:50:48.214537 tst switch_tch_pdch.py: using RAC 185 08:50:48.336279 tst switch_tch_pdch.py: using CellId 32825 08:50:48.457524 tst switch_tch_pdch.py: using BVCI 32826 08:50:48.571370 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.582937 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.594174 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.605336 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.616062 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.627201 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.638700 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:48.650310 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:50:48.767253 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:50:48.884351 tst switch_tch_pdch.py:51: start network... 08:50:49.093877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:49.548494 run create_hlr_db(pid=28249): Launched 08:50:49.674526 bus /gobi_6: Setting Powered False 08:50:50.737314 run create_hlr_db(pid=28249): Terminated: ok {rc=0} 08:50:51.127109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28251): Launched 08:50:51.416181 run osmo-hlr_10.42.42.2(pid=28252): Launched 08:50:51.527003 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:52.018144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Launched 08:50:52.306318 run osmo-stp_10.42.42.5(pid=28260): Launched 08:50:52.415785 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:52.888487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28262): Launched 08:50:52.999424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:53.243067 run patchelf(pid=28263): Launched 08:50:53.403281 run osmo-stp_10.42.42.5(pid=28260): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] 08:50:53.525577 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-13_08:50:52.253372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:53.649515 run osmo-stp_10.42.42.5(pid=28260): stderr: | 20221213085052421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085052421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085052421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085052422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085052422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085052422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085052422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:53.773748 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-13_08:50:52.253372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:53.892464 run osmo-stp_10.42.42.5(pid=28260): stderr: | 20221213085052421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085052421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085052421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085052422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085052422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085052422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085052422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:54.033069 run patchelf(pid=28263): Terminating (SIGINT) 08:50:54.194703 run patchelf(pid=28263): Terminated: ok {rc=0} 08:50:54.311336 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2387↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] [trial-2387↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:50:54.320224 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 08:50:54.346196 run osmo-hlr_10.42.42.2(pid=28252): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28252)] 08:50:54.394040 run osmo-hlr_10.42.42.2(pid=28252): stdout: | (launched: 2022-12-13_08:50:51.363672) 08:50:54.442714 run osmo-hlr_10.42.42.2(pid=28252): stderr: | 20221213085051539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085051539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085051539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085051539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085051539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085051539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085051551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085051560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085051560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085051560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:54.491507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28251): Terminating (SIGTERM) 08:50:54.530973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminating (SIGTERM) 08:50:54.570229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28262): Terminating (SIGTERM) 08:50:54.609623 --- ParallelTerminationStrategy: PID 28251 died... 08:50:54.628388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28251): Terminated: ok {rc=0} 08:50:54.671834 --- ParallelTerminationStrategy: PID 28259 died... 08:50:54.690281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminated: ok {rc=0} 08:50:54.733719 --- ParallelTerminationStrategy: PID 28262 died... 08:50:54.752354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28262): Terminated: ok {rc=0} 08:50:54.836809 bus /gobi_0: Setting Powered False 08:50:55.935014 bus /gobi_0: Setting Powered False 08:50:57.045829 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_sms:trx-b200 --------------------------------------------------------------------- 08:50:58.284204 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:58.289140 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:50:58.323268 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:50:58.330470 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:50:58.381297 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:50:58.415075 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:50:58.422398 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:50:58.964028 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:50:58.969887 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 08:50:58.981453 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 08:50:59.030686 tst mo_mt_sms.py: using LAC 32826 08:50:59.156190 tst mo_mt_sms.py: using RAC 186 08:50:59.278320 tst mo_mt_sms.py: using CellId 32826 08:50:59.401868 tst mo_mt_sms.py: using BVCI 32827 08:50:59.509907 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:50:59.628860 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:50:59.744069 tst mo_mt_sms.py:9: start nitb and bts... 08:50:59.939226 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:51:00.532939 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28267): Launched 08:51:00.823161 run osmo-nitb_10.42.42.2(pid=28268): Launched 08:51:01.014271 run osmo-nitb_10.42.42.2(pid=28268): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28268)] 08:51:01.158374 run osmo-nitb_10.42.42.2(pid=28268): stdout: | (launched: 2022-12-13_08:51:00.770459) 08:51:01.305819 run osmo-nitb_10.42.42.2(pid=28268): stderr: | (launched: 2022-12-13_08:51:00.813972) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:51:01.451082 run osmo-nitb_10.42.42.2(pid=28268): stdout: | (launched: 2022-12-13_08:51:00.770459) 08:51:01.591597 run osmo-nitb_10.42.42.2(pid=28268): stderr: | (launched: 2022-12-13_08:51:00.813972) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28268): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28268) [trial-2387↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28268)] 08:51:01.941900 tst osmo-nitb_10.42.42.2(pid=28268): stdout: | (launched: 2022-12-13_08:51:00.770459) 08:51:02.068482 tst osmo-nitb_10.42.42.2(pid=28268): stderr: | (launched: 2022-12-13_08:51:00.813972) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:51:02.221138 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28268): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28268) [trial-2387↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28268)] [trial-2387↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 08:51:02.230508 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 08:51:02.239134 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28267): Terminating (SIGTERM) 08:51:02.450632 --- ParallelTerminationStrategy: PID 28267 died... 08:51:02.472795 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28267): Terminated: ok {rc=0} 08:51:02.560602 bus /sierra_3: Setting Powered False 08:51:03.659538 bus /sierra_3: Setting Powered False 08:51:04.777678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:trx-b200 --------------------------------------------------------------------- 08:51:05.975422 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:05.979801 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:51:06.013640 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:51:06.040865 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:51:06.093934 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:51:06.127111 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:51:06.153832 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:51:06.701173 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:51:06.707222 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:06.718305 tst sms:trx-b200: Using 1 x bts (candidates: 1) 08:51:06.766479 tst mo_mt_sms.py: using LAC 32827 08:51:06.881383 tst mo_mt_sms.py: using RAC 187 08:51:07.058144 tst mo_mt_sms.py: using CellId 32827 08:51:07.173405 tst mo_mt_sms.py: using BVCI 32828 08:51:07.286606 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:07.297789 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:07.308830 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:07.319537 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:07.330522 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:07.341799 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:51:07.457130 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:51:07.573598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:08.054359 run create_hlr_db(pid=28273): Launched 08:51:08.181499 bus /sierra_2: Setting Powered False 08:51:09.243181 run create_hlr_db(pid=28273): Terminated: ok {rc=0} 08:51:09.659006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28275): Launched 08:51:09.948373 run osmo-hlr_10.42.42.2(pid=28276): Launched 08:51:10.059647 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:10.571791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28278): Launched 08:51:10.860070 run osmo-stp_10.42.42.5(pid=28279): Launched 08:51:10.970545 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:11.495766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28281): Launched 08:51:11.783404 run osmo-msc_10.42.42.6(pid=28282): Launched 08:51:11.946115 run osmo-stp_10.42.42.5(pid=28279): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28279)] 08:51:12.069408 run osmo-stp_10.42.42.5(pid=28279): stdout: | (launched: 2022-12-13_08:51:10.807392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:12.193243 run osmo-stp_10.42.42.5(pid=28279): stderr: | 20221213085110976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085110976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085110976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085110976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085110977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085110977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085110977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:12.314235 run osmo-stp_10.42.42.5(pid=28279): stdout: | (launched: 2022-12-13_08:51:10.807392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:12.429694 run osmo-stp_10.42.42.5(pid=28279): stderr: | 20221213085110976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085110976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085110976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085110976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085110977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085110977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085110977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:12.568156 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28279): Process ended prematurely: osmo-stp_10.42.42.5(pid=28279) [trial-2387↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28279)] [trial-2387↪sms:trx-b200↪mo_mt_sms.py:16] 08:51:12.576283 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 08:51:12.601860 run osmo-hlr_10.42.42.2(pid=28276): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28276)] 08:51:12.649876 run osmo-hlr_10.42.42.2(pid=28276): stdout: | (launched: 2022-12-13_08:51:09.896038) 08:51:12.699387 run osmo-hlr_10.42.42.2(pid=28276): stderr: | 20221213085110069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085110069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085110069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085110069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085110069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085110069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085110085 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085110095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085110095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085110095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:12.768793 run osmo-msc_10.42.42.6(pid=28282): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28282)] 08:51:12.816162 run osmo-msc_10.42.42.6(pid=28282): stdout: | (launched: 2022-12-13_08:51:11.730886) 08:51:12.865449 run osmo-msc_10.42.42.6(pid=28282): stderr: | 20221213085112000 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085112000 DLGLOBAL DEBUG validating counter group 0x7f62962a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085112001 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085112001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085112001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085112001 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085112004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085112005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085112005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085112005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:12.915417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28275): Terminating (SIGTERM) 08:51:12.955045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28278): Terminating (SIGTERM) 08:51:12.994538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28281): Terminating (SIGTERM) 08:51:13.034246 --- ParallelTerminationStrategy: PID 28275 died... 08:51:13.053396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28275): Terminated: ok {rc=0} 08:51:13.096919 --- ParallelTerminationStrategy: PID 28278 died... 08:51:13.115500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28278): Terminated: ok {rc=0} 08:51:13.159022 --- ParallelTerminationStrategy: PID 28281 died... 08:51:13.177535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28281): Terminated: ok {rc=0} 08:51:13.262709 bus /sierra_3: Setting Powered False 08:51:14.359732 bus /sierra_3: Setting Powered False 08:51:15.472014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-b200 --------------------------------------------------------------------- 08:51:16.698374 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:16.705392 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:51:16.747299 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:51:16.756657 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:51:16.802810 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:51:16.858193 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:51:16.866839 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:51:17.370442 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:51:17.376351 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 08:51:17.387654 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 08:51:17.440432 tst assert_extension.py: using LAC 32828 08:51:17.567725 tst assert_extension.py: using RAC 188 08:51:17.694011 tst assert_extension.py: using CellId 32828 08:51:17.816590 tst assert_extension.py: using BVCI 32829 08:51:17.929518 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 08:51:18.043653 tst assert_extension.py:10: start nitb and bts... 08:51:18.237663 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:51:18.869457 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28287): Launched 08:51:19.178468 run osmo-nitb_10.42.42.2(pid=28288): Launched 08:51:19.349715 run osmo-nitb_10.42.42.2(pid=28288): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28288)] 08:51:19.488748 run osmo-nitb_10.42.42.2(pid=28288): stdout: | (launched: 2022-12-13_08:51:19.122784) 08:51:19.630166 run osmo-nitb_10.42.42.2(pid=28288): stderr: | (launched: 2022-12-13_08:51:19.169025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:51:19.771781 run osmo-nitb_10.42.42.2(pid=28288): stdout: | (launched: 2022-12-13_08:51:19.122784) 08:51:19.907367 run osmo-nitb_10.42.42.2(pid=28288): stderr: | (launched: 2022-12-13_08:51:19.169025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28288): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28288) [trial-2387↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28288)] 08:51:20.294711 tst osmo-nitb_10.42.42.2(pid=28288): stdout: | (launched: 2022-12-13_08:51:19.122784) 08:51:20.420111 tst osmo-nitb_10.42.42.2(pid=28288): stderr: | (launched: 2022-12-13_08:51:19.169025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:51:20.567970 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28288): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28288) [trial-2387↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28288)] [trial-2387↪nitb_ussd:trx-b200↪assert_extension.py:12] 08:51:20.576780 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:51:20.583602 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28287): Terminating (SIGTERM) 08:51:20.793635 --- ParallelTerminationStrategy: PID 28287 died... 08:51:20.815500 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28287): Terminated: ok {rc=0} 08:51:20.903011 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:trx-b200 --------------------------------------------------------------------- 08:51:22.117858 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:22.122289 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:51:22.155720 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:51:22.183591 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:51:22.219515 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:51:22.253444 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:51:22.281081 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:51:22.810244 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:51:22.815610 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:22.826738 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 08:51:22.875388 tst assert_extension.py: using LAC 32829 08:51:22.997631 tst assert_extension.py: using RAC 189 08:51:23.113390 tst assert_extension.py: using CellId 32829 08:51:23.235807 tst assert_extension.py: using BVCI 32830 08:51:23.347482 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:23.358356 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:23.368812 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:23.379117 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:23.389378 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:51:23.399985 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 08:51:23.516257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:23.997931 run create_hlr_db(pid=28292): Launched 08:51:24.124381 bus /sierra_2: Setting Powered False 08:51:25.185606 run create_hlr_db(pid=28292): Terminated: ok {rc=0} 08:51:25.601286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28294): Launched 08:51:25.891141 run osmo-hlr_10.42.42.2(pid=28295): Launched 08:51:26.002948 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:26.518368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28297): Launched 08:51:26.807087 run osmo-stp_10.42.42.5(pid=28298): Launched 08:51:26.917665 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:27.440706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28300): Launched 08:51:27.730296 run osmo-msc_10.42.42.6(pid=28301): Launched 08:51:27.891660 run osmo-stp_10.42.42.5(pid=28298): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28298)] 08:51:28.014954 run osmo-stp_10.42.42.5(pid=28298): stdout: | (launched: 2022-12-13_08:51:26.754737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:28.138987 run osmo-stp_10.42.42.5(pid=28298): stderr: | 20221213085126921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085126921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085126921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085126922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085126924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085126924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085126924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:28.260356 run osmo-stp_10.42.42.5(pid=28298): stdout: | (launched: 2022-12-13_08:51:26.754737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:28.376059 run osmo-stp_10.42.42.5(pid=28298): stderr: | 20221213085126921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085126921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085126921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085126922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085126924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085126924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085126924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:28.514854 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28298): Process ended prematurely: osmo-stp_10.42.42.5(pid=28298) [trial-2387↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28298)] [trial-2387↪ussd:trx-b200↪assert_extension.py:17] 08:51:28.523262 tst assert_extension.py:17: Test FAILED (5.7 sec) 08:51:28.548911 run osmo-hlr_10.42.42.2(pid=28295): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28295)] 08:51:28.597544 run osmo-hlr_10.42.42.2(pid=28295): stdout: | (launched: 2022-12-13_08:51:25.838631) 08:51:28.647435 run osmo-hlr_10.42.42.2(pid=28295): stderr: | 20221213085126010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085126010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085126010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085126010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085126010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085126010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085126023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085126033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085126034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085126034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:28.717230 run osmo-msc_10.42.42.6(pid=28301): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28301)] 08:51:28.764528 run osmo-msc_10.42.42.6(pid=28301): stdout: | (launched: 2022-12-13_08:51:27.677359) 08:51:28.814140 run osmo-msc_10.42.42.6(pid=28301): stderr: | 20221213085127946 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085127947 DLGLOBAL DEBUG validating counter group 0x7f9cffe65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085127947 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085127947 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085127947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085127947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085127949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085127949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085127949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085127950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:28.863838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28294): Terminating (SIGTERM) 08:51:28.903687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28297): Terminating (SIGTERM) 08:51:28.943593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28300): Terminating (SIGTERM) 08:51:28.984133 --- ParallelTerminationStrategy: PID 28294 died... 08:51:29.003692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28294): Terminated: ok {rc=0} 08:51:29.047921 --- ParallelTerminationStrategy: PID 28297 died... 08:51:29.066830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28297): Terminated: ok {rc=0} 08:51:29.110688 --- ParallelTerminationStrategy: PID 28300 died... 08:51:29.129634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28300): Terminated: ok {rc=0} 08:51:29.215572 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:51:30.428429 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:30.435111 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:51:30.466932 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:51:30.495305 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:51:30.546557 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:51:30.579402 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:51:30.606593 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:51:31.178439 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:51:31.245543 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:31.261541 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:51:31.343663 tst mo_mt_call.py: using LAC 32830 08:51:31.464464 tst mo_mt_call.py: using RAC 190 08:51:31.589822 tst mo_mt_call.py: using CellId 32830 08:51:31.755857 tst mo_mt_call.py: using BVCI 32831 08:51:31.909357 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:31.921758 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:31.937415 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:31.954454 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:31.971630 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:31.988420 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:32.136650 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:32.265769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:32.758743 run create_hlr_db(pid=28306): Launched 08:51:32.888756 bus /sierra_2: Setting Powered False 08:51:33.951844 run create_hlr_db(pid=28306): Terminated: ok {rc=0} 08:51:34.373192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Launched 08:51:34.667519 run osmo-hlr_10.42.42.2(pid=28309): Launched 08:51:34.779637 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:35.286688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Launched 08:51:35.580296 run osmo-stp_10.42.42.5(pid=28312): Launched 08:51:35.692591 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:36.225126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28314): Launched 08:51:36.519927 run osmo-msc_10.42.42.6(pid=28315): Launched 08:51:36.685149 run osmo-stp_10.42.42.5(pid=28312): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] 08:51:36.811482 run osmo-stp_10.42.42.5(pid=28312): stdout: | (launched: 2022-12-13_08:51:35.527156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:36.937338 run osmo-stp_10.42.42.5(pid=28312): stderr: | 20221213085135695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085135695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085135696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085135696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085135698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085135699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085135699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:37.060719 run osmo-stp_10.42.42.5(pid=28312): stdout: | (launched: 2022-12-13_08:51:35.527156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:37.179493 run osmo-stp_10.42.42.5(pid=28312): stderr: | 20221213085135695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085135695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085135696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085135696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085135698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085135699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085135699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:37.321178 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28312): Process ended prematurely: osmo-stp_10.42.42.5(pid=28312) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:51:37.330148 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:51:37.356183 run osmo-hlr_10.42.42.2(pid=28309): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28309)] 08:51:37.404846 run osmo-hlr_10.42.42.2(pid=28309): stdout: | (launched: 2022-12-13_08:51:34.614180) 08:51:37.454713 run osmo-hlr_10.42.42.2(pid=28309): stderr: | 20221213085134788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085134788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085134788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085134788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085134788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085134788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085134854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085134862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085134863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085134863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:37.524096 run osmo-msc_10.42.42.6(pid=28315): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28315)] 08:51:37.571497 run osmo-msc_10.42.42.6(pid=28315): stdout: | (launched: 2022-12-13_08:51:36.466291) 08:51:37.621256 run osmo-msc_10.42.42.6(pid=28315): stderr: | 20221213085136737 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085136738 DLGLOBAL DEBUG validating counter group 0x7f9016e73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085136738 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085136738 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085136738 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085136738 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085136741 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085136742 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085136742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085136742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:37.671158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Terminating (SIGTERM) 08:51:37.711043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Terminating (SIGTERM) 08:51:37.750956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28314): Terminating (SIGTERM) 08:51:37.791002 --- ParallelTerminationStrategy: PID 28308 died... 08:51:37.810570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Terminated: ok {rc=0} 08:51:37.854752 --- ParallelTerminationStrategy: PID 28311 died... 08:51:37.873629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Terminated: ok {rc=0} 08:51:37.917498 --- ParallelTerminationStrategy: PID 28314 died... 08:51:37.936336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28314): Terminated: ok {rc=0} 08:51:38.020366 bus /sierra_3: Setting Powered False 08:51:39.117600 bus /sierra_3: Setting Powered False 08:51:40.235490 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:51:41.379423 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:41.391103 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:51:41.460730 tst mo_mt_call_osmux.py: using LAC 32831 08:51:41.576828 tst mo_mt_call_osmux.py: using RAC 191 08:51:41.693125 tst mo_mt_call_osmux.py: using CellId 32831 08:51:41.812041 tst mo_mt_call_osmux.py: using BVCI 32832 08:51:41.919300 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:41.930556 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:41.941399 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:41.951970 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:41.963408 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:41.974664 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:42.089188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:42.207654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:42.696705 run create_hlr_db(pid=28317): Launched 08:51:42.815940 bus /sierra_2: Setting Powered False 08:51:43.875599 run create_hlr_db(pid=28317): Terminated: ok {rc=0} 08:51:44.309055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28319): Launched 08:51:44.623193 run osmo-hlr_10.42.42.2(pid=28321): Launched 08:51:44.742809 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:45.287347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28323): Launched 08:51:45.602261 run osmo-stp_10.42.42.5(pid=28324): Launched 08:51:45.722435 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:46.303167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28326): Launched 08:51:46.715640 run osmo-msc_10.42.42.6(pid=28327): Launched 08:51:46.987447 run osmo-stp_10.42.42.5(pid=28324): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28324)] 08:51:47.290471 run osmo-stp_10.42.42.5(pid=28324): stdout: | (launched: 2022-12-13_08:51:45.545624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:47.502718 run osmo-stp_10.42.42.5(pid=28324): stderr: | 20221213085145735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085145736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085145736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085145736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085145738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085145739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085145739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:47.636121 run osmo-stp_10.42.42.5(pid=28324): stdout: | (launched: 2022-12-13_08:51:45.545624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:47.762631 run osmo-stp_10.42.42.5(pid=28324): stderr: | 20221213085145735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085145736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085145736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085145736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085145738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085145739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085145739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:47.913309 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28324): Process ended prematurely: osmo-stp_10.42.42.5(pid=28324) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28324)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:51:47.923033 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:51:47.950555 run osmo-hlr_10.42.42.2(pid=28321): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28321)] 08:51:48.001133 run osmo-hlr_10.42.42.2(pid=28321): stdout: | (launched: 2022-12-13_08:51:44.566745) 08:51:48.053220 run osmo-hlr_10.42.42.2(pid=28321): stderr: | 20221213085144763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085144763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085144763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085144763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085144763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085144763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085144776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085144784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085144785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085144785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:48.125842 run osmo-msc_10.42.42.6(pid=28327): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28327)] 08:51:48.177020 run osmo-msc_10.42.42.6(pid=28327): stdout: | (launched: 2022-12-13_08:51:46.643131) 08:51:48.228749 run osmo-msc_10.42.42.6(pid=28327): stderr: | 20221213085147221 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085147221 DLGLOBAL DEBUG validating counter group 0x7f57b86fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085147221 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085147222 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085147222 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085147222 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085147223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085147224 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085147224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085147224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:48.280828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28319): Terminating (SIGTERM) 08:51:48.322727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28323): Terminating (SIGTERM) 08:51:48.364611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28326): Terminating (SIGTERM) 08:51:48.406693 --- ParallelTerminationStrategy: PID 28319 died... 08:51:48.426836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28319): Terminated: ok {rc=0} 08:51:48.473193 --- ParallelTerminationStrategy: PID 28323 died... 08:51:48.492651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28323): Terminated: ok {rc=0} 08:51:48.538855 --- ParallelTerminationStrategy: PID 28326 died... 08:51:48.558437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28326): Terminated: ok {rc=0} 08:51:48.645493 bus /sierra_3: Setting Powered False 08:51:49.743415 bus /sierra_3: Setting Powered False 08:51:50.858563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:51:52.104831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:52.111473 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:51:52.143605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:51:52.171091 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:51:52.223038 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:51:52.256363 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:51:52.283568 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:51:52.830822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:51:52.878970 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:52.890180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:51:52.959769 tst mo_mt_call.py: using LAC 32832 08:51:53.075179 tst mo_mt_call.py: using RAC 192 08:51:53.191523 tst mo_mt_call.py: using CellId 32832 08:51:53.309599 tst mo_mt_call.py: using BVCI 32833 08:51:53.417681 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:53.428816 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:53.439857 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:53.450867 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:53.462450 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:53.473772 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:51:53.589097 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:51:53.708622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:54.196472 run create_hlr_db(pid=28332): Launched 08:51:54.325198 bus /sierra_2: Setting Powered False 08:51:55.388192 run create_hlr_db(pid=28332): Terminated: ok {rc=0} 08:51:55.808375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28334): Launched 08:51:56.101821 run osmo-hlr_10.42.42.2(pid=28335): Launched 08:51:56.213974 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:56.720659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28337): Launched 08:51:57.014889 run osmo-stp_10.42.42.5(pid=28338): Launched 08:51:57.128074 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:57.662100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28340): Launched 08:51:57.956054 run osmo-msc_10.42.42.6(pid=28341): Launched 08:51:58.121408 run osmo-stp_10.42.42.5(pid=28338): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28338)] 08:51:58.247540 run osmo-stp_10.42.42.5(pid=28338): stdout: | (launched: 2022-12-13_08:51:56.961752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:58.373666 run osmo-stp_10.42.42.5(pid=28338): stderr: | 20221213085157129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085157129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085157130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085157130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085157131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085157131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085157131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:58.497404 run osmo-stp_10.42.42.5(pid=28338): stdout: | (launched: 2022-12-13_08:51:56.961752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:58.615765 run osmo-stp_10.42.42.5(pid=28338): stderr: | 20221213085157129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085157129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085157130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085157130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085157131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085157131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085157131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:58.757400 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28338): Process ended prematurely: osmo-stp_10.42.42.5(pid=28338) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28338)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:51:58.766382 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 08:51:58.792319 run osmo-hlr_10.42.42.2(pid=28335): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28335)] 08:51:58.840548 run osmo-hlr_10.42.42.2(pid=28335): stdout: | (launched: 2022-12-13_08:51:56.048822) 08:51:58.890207 run osmo-hlr_10.42.42.2(pid=28335): stderr: | 20221213085156224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085156224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085156224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085156224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085156224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085156224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085156264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085156273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085156273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085156274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:58.959513 run osmo-msc_10.42.42.6(pid=28341): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28341)] 08:51:59.006493 run osmo-msc_10.42.42.6(pid=28341): stdout: | (launched: 2022-12-13_08:51:57.902868) 08:51:59.055951 run osmo-msc_10.42.42.6(pid=28341): stderr: | 20221213085158175 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085158175 DLGLOBAL DEBUG validating counter group 0x7f133968fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085158175 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085158175 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085158175 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085158175 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085158177 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085158178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085158178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085158178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:59.105833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28334): Terminating (SIGTERM) 08:51:59.145821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28337): Terminating (SIGTERM) 08:51:59.185910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28340): Terminating (SIGTERM) 08:51:59.226223 --- ParallelTerminationStrategy: PID 28334 died... 08:51:59.246116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28334): Terminated: ok {rc=0} 08:51:59.290553 --- ParallelTerminationStrategy: PID 28337 died... 08:51:59.309726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28337): Terminated: ok {rc=0} 08:51:59.354221 --- ParallelTerminationStrategy: PID 28340 died... 08:51:59.373528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28340): Terminated: ok {rc=0} 08:51:59.460016 bus /sierra_3: Setting Powered False 08:52:00.558713 bus /sierra_3: Setting Powered False 08:52:01.683647 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:52:02.833886 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:52:02.846148 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:52:02.917852 tst mo_mt_call_osmux.py: using LAC 32833 08:52:03.043925 tst mo_mt_call_osmux.py: using RAC 193 08:52:03.168059 tst mo_mt_call_osmux.py: using CellId 32833 08:52:03.292280 tst mo_mt_call_osmux.py: using BVCI 32834 08:52:03.407006 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:52:03.418577 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:52:03.429899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:52:03.441268 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:52:03.452753 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:52:03.464265 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:52:03.584015 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:52:03.701124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:04.157637 run create_hlr_db(pid=28343): Launched 08:52:04.272049 bus /sierra_2: Setting Powered False 08:52:05.332243 run create_hlr_db(pid=28343): Terminated: ok {rc=0} 08:52:05.745904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28345): Launched 08:52:06.040820 run osmo-hlr_10.42.42.2(pid=28346): Launched 08:52:06.154480 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:06.680251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28348): Launched 08:52:06.974305 run osmo-stp_10.42.42.5(pid=28349): Launched 08:52:07.086515 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:07.625897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28351): Launched 08:52:07.921214 run osmo-msc_10.42.42.6(pid=28352): Launched 08:52:08.086393 run osmo-stp_10.42.42.5(pid=28349): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28349)] 08:52:08.212713 run osmo-stp_10.42.42.5(pid=28349): stdout: | (launched: 2022-12-13_08:52:06.921100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:08.338974 run osmo-stp_10.42.42.5(pid=28349): stderr: | 20221213085207087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085207087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085207088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085207088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085207090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085207090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085207091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:08.462774 run osmo-stp_10.42.42.5(pid=28349): stdout: | (launched: 2022-12-13_08:52:06.921100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:08.581251 run osmo-stp_10.42.42.5(pid=28349): stderr: | 20221213085207087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085207087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085207088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085207088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085207090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085207090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085207091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:08.722775 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28349): Process ended prematurely: osmo-stp_10.42.42.5(pid=28349) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28349)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:52:08.731556 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 08:52:08.757626 run osmo-hlr_10.42.42.2(pid=28346): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28346)] 08:52:08.806125 run osmo-hlr_10.42.42.2(pid=28346): stdout: | (launched: 2022-12-13_08:52:05.987492) 08:52:08.855768 run osmo-hlr_10.42.42.2(pid=28346): stderr: | 20221213085206160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085206160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085206160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085206160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085206161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085206161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085206173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085206182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085206182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085206182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:08.924907 run osmo-msc_10.42.42.6(pid=28352): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28352)] 08:52:08.972161 run osmo-msc_10.42.42.6(pid=28352): stdout: | (launched: 2022-12-13_08:52:07.867561) 08:52:09.021435 run osmo-msc_10.42.42.6(pid=28352): stderr: | 20221213085208139 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085208139 DLGLOBAL DEBUG validating counter group 0x7ff4dfd42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085208139 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085208140 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085208140 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085208140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085208142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085208142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085208142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085208142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:09.071078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28345): Terminating (SIGTERM) 08:52:09.110736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28348): Terminating (SIGTERM) 08:52:09.150346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28351): Terminating (SIGTERM) 08:52:09.190275 --- ParallelTerminationStrategy: PID 28345 died... 08:52:09.209438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28345): Terminated: ok {rc=0} 08:52:09.253348 --- ParallelTerminationStrategy: PID 28348 died... 08:52:09.271923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28348): Terminated: ok {rc=0} 08:52:09.315540 --- ParallelTerminationStrategy: PID 28351 died... 08:52:09.334283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28351): Terminated: ok {rc=0} 08:52:09.419631 bus /sierra_3: Setting Powered False 08:52:10.518321 bus /sierra_3: Setting Powered False 08:52:11.632740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:52:12.883886 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:12.891688 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:52:12.925591 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:52:12.952527 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:52:13.003825 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:52:13.036485 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:52:13.063586 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:52:13.612503 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:52:13.660673 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:13.671884 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:52:13.740517 tst mo_mt_call.py: using LAC 32834 08:52:13.856892 tst mo_mt_call.py: using RAC 194 08:52:13.973374 tst mo_mt_call.py: using CellId 32834 08:52:14.090973 tst mo_mt_call.py: using BVCI 32835 08:52:14.198992 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:14.210210 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:14.221186 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:14.232078 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:14.243387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:14.254679 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:14.368672 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:14.488602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:14.978003 run create_hlr_db(pid=28357): Launched 08:52:15.106938 bus /sierra_2: Setting Powered False 08:52:16.168705 run create_hlr_db(pid=28357): Terminated: ok {rc=0} 08:52:16.598530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28360): Launched 08:52:16.929697 run osmo-hlr_10.42.42.2(pid=28361): Launched 08:52:17.074956 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:17.740707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28363): Launched 08:52:18.055873 run osmo-stp_10.42.42.5(pid=28364): Launched 08:52:18.176247 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:18.747761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28366): Launched 08:52:19.063283 run osmo-msc_10.42.42.6(pid=28367): Launched 08:52:19.239786 run osmo-stp_10.42.42.5(pid=28364): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28364)] 08:52:19.373178 run osmo-stp_10.42.42.5(pid=28364): stdout: | (launched: 2022-12-13_08:52:17.999079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:19.507689 run osmo-stp_10.42.42.5(pid=28364): stderr: | 20221213085218188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085218188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085218188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085218189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085218191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085218191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085218191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:19.641265 run osmo-stp_10.42.42.5(pid=28364): stdout: | (launched: 2022-12-13_08:52:17.999079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:19.768091 run osmo-stp_10.42.42.5(pid=28364): stderr: | 20221213085218188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085218188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085218188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085218189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085218191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085218191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085218191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:19.919453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28364): Process ended prematurely: osmo-stp_10.42.42.5(pid=28364) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28364)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:52:19.929087 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:52:19.956739 run osmo-hlr_10.42.42.2(pid=28361): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28361)] 08:52:20.006933 run osmo-hlr_10.42.42.2(pid=28361): stdout: | (launched: 2022-12-13_08:52:16.863161) 08:52:20.058717 run osmo-hlr_10.42.42.2(pid=28361): stderr: | 20221213085217242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085217242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085217242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085217242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085217242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085217242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085217266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085217283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085217283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085217283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:20.131150 run osmo-msc_10.42.42.6(pid=28367): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28367)] 08:52:20.180781 run osmo-msc_10.42.42.6(pid=28367): stdout: | (launched: 2022-12-13_08:52:19.006515) 08:52:20.232324 run osmo-msc_10.42.42.6(pid=28367): stderr: | 20221213085219328 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085219329 DLGLOBAL DEBUG validating counter group 0x7faaad332c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085219329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085219329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085219329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085219329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085219331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085219331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085219331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085219332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:20.284289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28360): Terminating (SIGTERM) 08:52:20.326330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28363): Terminating (SIGTERM) 08:52:20.368161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28366): Terminating (SIGTERM) 08:52:20.410270 --- ParallelTerminationStrategy: PID 28360 died... 08:52:20.430350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28360): Terminated: ok {rc=0} 08:52:20.476641 --- ParallelTerminationStrategy: PID 28363 died... 08:52:20.496467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28363): Terminated: ok {rc=0} 08:52:20.542557 --- ParallelTerminationStrategy: PID 28366 died... 08:52:20.562409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28366): Terminated: ok {rc=0} 08:52:20.650507 bus /sierra_3: Setting Powered False 08:52:21.745971 bus /sierra_3: Setting Powered False 08:52:22.860223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:52:24.009879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:24.022078 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:52:24.093501 tst mo_mt_call_osmux.py: using LAC 32835 08:52:24.218197 tst mo_mt_call_osmux.py: using RAC 195 08:52:24.344379 tst mo_mt_call_osmux.py: using CellId 32835 08:52:24.469871 tst mo_mt_call_osmux.py: using BVCI 32836 08:52:24.586431 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:24.597951 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:24.609262 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:24.620343 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:24.631924 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:24.643313 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:24.762236 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:24.879063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:25.337805 run create_hlr_db(pid=28369): Launched 08:52:25.451587 bus /sierra_2: Setting Powered False 08:52:26.510635 run create_hlr_db(pid=28369): Terminated: ok {rc=0} 08:52:26.921855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28371): Launched 08:52:27.215552 run osmo-hlr_10.42.42.2(pid=28372): Launched 08:52:27.328612 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:27.839808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28374): Launched 08:52:28.133315 run osmo-stp_10.42.42.5(pid=28375): Launched 08:52:28.245504 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:28.778684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28377): Launched 08:52:29.073205 run osmo-msc_10.42.42.6(pid=28378): Launched 08:52:29.239233 run osmo-stp_10.42.42.5(pid=28375): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28375)] 08:52:29.364899 run osmo-stp_10.42.42.5(pid=28375): stdout: | (launched: 2022-12-13_08:52:28.080021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:29.491892 run osmo-stp_10.42.42.5(pid=28375): stderr: | 20221213085228249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085228249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085228249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085228250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085228250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085228250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085228250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:29.615419 run osmo-stp_10.42.42.5(pid=28375): stdout: | (launched: 2022-12-13_08:52:28.080021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:29.733924 run osmo-stp_10.42.42.5(pid=28375): stderr: | 20221213085228249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085228249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085228249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085228250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085228250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085228250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085228250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:29.875100 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28375): Process ended prematurely: osmo-stp_10.42.42.5(pid=28375) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28375)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:52:29.883838 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 08:52:29.909869 run osmo-hlr_10.42.42.2(pid=28372): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28372)] 08:52:29.958395 run osmo-hlr_10.42.42.2(pid=28372): stdout: | (launched: 2022-12-13_08:52:27.162261) 08:52:30.007706 run osmo-hlr_10.42.42.2(pid=28372): stderr: | 20221213085227335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085227336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085227336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085227336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085227336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085227336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085227348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085227356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085227356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085227356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:30.076551 run osmo-msc_10.42.42.6(pid=28378): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28378)] 08:52:30.123273 run osmo-msc_10.42.42.6(pid=28378): stdout: | (launched: 2022-12-13_08:52:29.019463) 08:52:30.172075 run osmo-msc_10.42.42.6(pid=28378): stderr: | 20221213085229294 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085229294 DLGLOBAL DEBUG validating counter group 0x7f3142a87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085229294 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085229294 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085229294 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085229295 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085229297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085229298 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085229298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085229298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:30.221168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28371): Terminating (SIGTERM) 08:52:30.260373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28374): Terminating (SIGTERM) 08:52:30.299771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28377): Terminating (SIGTERM) 08:52:30.339283 --- ParallelTerminationStrategy: PID 28371 died... 08:52:30.358486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28371): Terminated: ok {rc=0} 08:52:30.402136 --- ParallelTerminationStrategy: PID 28374 died... 08:52:30.420662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28374): Terminated: ok {rc=0} 08:52:30.464186 --- ParallelTerminationStrategy: PID 28377 died... 08:52:30.482880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28377): Terminated: ok {rc=0} 08:52:30.567751 bus /sierra_3: Setting Powered False 08:52:31.675215 bus /sierra_3: Setting Powered False 08:52:32.795330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:52:34.042469 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:34.050124 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:52:34.084148 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:52:34.111885 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:52:34.164438 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:52:34.197281 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:52:34.224075 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:52:34.774777 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:52:34.823187 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:34.834507 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:52:34.903928 tst mo_mt_call.py: using LAC 32836 08:52:35.020191 tst mo_mt_call.py: using RAC 196 08:52:35.136524 tst mo_mt_call.py: using CellId 32836 08:52:35.258053 tst mo_mt_call.py: using BVCI 32837 08:52:35.367532 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:35.378520 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:35.389358 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:35.399940 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:35.411210 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:35.422407 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:35.537646 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:35.656790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:36.146469 run create_hlr_db(pid=28383): Launched 08:52:36.273935 bus /sierra_2: Setting Powered False 08:52:37.336162 run create_hlr_db(pid=28383): Terminated: ok {rc=0} 08:52:37.758249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28385): Launched 08:52:38.052907 run osmo-hlr_10.42.42.2(pid=28386): Launched 08:52:38.165907 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:38.689184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28388): Launched 08:52:38.984211 run osmo-stp_10.42.42.5(pid=28389): Launched 08:52:39.096941 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:39.636238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28391): Launched 08:52:39.931097 run osmo-msc_10.42.42.6(pid=28392): Launched 08:52:40.097145 run osmo-stp_10.42.42.5(pid=28389): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28389)] 08:52:40.222769 run osmo-stp_10.42.42.5(pid=28389): stdout: | (launched: 2022-12-13_08:52:38.930581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:40.349075 run osmo-stp_10.42.42.5(pid=28389): stderr: | 20221213085239099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085239100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085239100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085239100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085239101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085239101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085239101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:40.472544 run osmo-stp_10.42.42.5(pid=28389): stdout: | (launched: 2022-12-13_08:52:38.930581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:40.591446 run osmo-stp_10.42.42.5(pid=28389): stderr: | 20221213085239099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085239100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085239100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085239100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085239101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085239101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085239101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:40.733082 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28389): Process ended prematurely: osmo-stp_10.42.42.5(pid=28389) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28389)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:52:40.742048 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:52:40.768128 run osmo-hlr_10.42.42.2(pid=28386): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28386)] 08:52:40.816504 run osmo-hlr_10.42.42.2(pid=28386): stdout: | (launched: 2022-12-13_08:52:37.999466) 08:52:40.865977 run osmo-hlr_10.42.42.2(pid=28386): stderr: | 20221213085238177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085238177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085238177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085238177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085238177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085238177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085238189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085238198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085238198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085238198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:40.934635 run osmo-msc_10.42.42.6(pid=28392): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28392)] 08:52:40.981681 run osmo-msc_10.42.42.6(pid=28392): stdout: | (launched: 2022-12-13_08:52:39.877917) 08:52:41.031037 run osmo-msc_10.42.42.6(pid=28392): stderr: | 20221213085240148 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085240149 DLGLOBAL DEBUG validating counter group 0x7f0c40386c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085240149 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085240149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085240149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085240149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085240151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085240151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085240151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085240151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:41.080546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28385): Terminating (SIGTERM) 08:52:41.120261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28388): Terminating (SIGTERM) 08:52:41.159943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28391): Terminating (SIGTERM) 08:52:41.199820 --- ParallelTerminationStrategy: PID 28385 died... 08:52:41.219163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28385): Terminated: ok {rc=0} 08:52:41.262975 --- ParallelTerminationStrategy: PID 28388 died... 08:52:41.281947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28388): Terminated: ok {rc=0} 08:52:41.325813 --- ParallelTerminationStrategy: PID 28391 died... 08:52:41.344665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28391): Terminated: ok {rc=0} 08:52:41.430715 bus /sierra_3: Setting Powered False 08:52:42.529189 bus /sierra_3: Setting Powered False 08:52:43.640668 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:52:44.787283 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:44.799611 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:52:44.870314 tst mo_mt_call_osmux.py: using LAC 32837 08:52:44.996101 tst mo_mt_call_osmux.py: using RAC 197 08:52:45.121057 tst mo_mt_call_osmux.py: using CellId 32837 08:52:45.245347 tst mo_mt_call_osmux.py: using BVCI 32838 08:52:45.359953 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:45.371438 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:45.382760 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:45.394031 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:45.405416 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:45.416639 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:45.536500 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:45.653512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:46.137446 run create_hlr_db(pid=28394): Launched 08:52:46.292815 bus /sierra_2: Setting Powered False 08:52:47.360130 run create_hlr_db(pid=28394): Terminated: ok {rc=0} 08:52:47.785644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28396): Launched 08:52:48.079705 run osmo-hlr_10.42.42.2(pid=28397): Launched 08:52:48.191964 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:48.697168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28399): Launched 08:52:48.990681 run osmo-stp_10.42.42.5(pid=28400): Launched 08:52:49.103462 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:49.637306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28402): Launched 08:52:49.932453 run osmo-msc_10.42.42.6(pid=28403): Launched 08:52:50.098263 run osmo-stp_10.42.42.5(pid=28400): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28400)] 08:52:50.223916 run osmo-stp_10.42.42.5(pid=28400): stdout: | (launched: 2022-12-13_08:52:48.937589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:50.349543 run osmo-stp_10.42.42.5(pid=28400): stderr: | 20221213085249106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085249106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085249107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085249107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085249107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085249107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085249108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:50.473090 run osmo-stp_10.42.42.5(pid=28400): stdout: | (launched: 2022-12-13_08:52:48.937589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:50.590917 run osmo-stp_10.42.42.5(pid=28400): stderr: | 20221213085249106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085249106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085249107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085249107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085249107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085249107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085249108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:50.732432 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28400): Process ended prematurely: osmo-stp_10.42.42.5(pid=28400) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28400)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:52:50.741604 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:52:50.767743 run osmo-hlr_10.42.42.2(pid=28397): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28397)] 08:52:50.816168 run osmo-hlr_10.42.42.2(pid=28397): stdout: | (launched: 2022-12-13_08:52:48.026140) 08:52:50.865817 run osmo-hlr_10.42.42.2(pid=28397): stderr: | 20221213085248202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085248202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085248202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085248202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085248202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085248203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085248254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085248264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085248265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085248265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:50.935150 run osmo-msc_10.42.42.6(pid=28403): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28403)] 08:52:50.982485 run osmo-msc_10.42.42.6(pid=28403): stdout: | (launched: 2022-12-13_08:52:49.878884) 08:52:51.031734 run osmo-msc_10.42.42.6(pid=28403): stderr: | 20221213085250150 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085250150 DLGLOBAL DEBUG validating counter group 0x7ff3120e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085250150 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085250151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085250151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085250151 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085250153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085250154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085250154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085250154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:51.081534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28396): Terminating (SIGTERM) 08:52:51.121510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28399): Terminating (SIGTERM) 08:52:51.161386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28402): Terminating (SIGTERM) 08:52:51.201452 --- ParallelTerminationStrategy: PID 28396 died... 08:52:51.221020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28396): Terminated: ok {rc=0} 08:52:51.265430 --- ParallelTerminationStrategy: PID 28399 died... 08:52:51.284152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28399): Terminated: ok {rc=0} 08:52:51.328105 --- ParallelTerminationStrategy: PID 28402 died... 08:52:51.347053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28402): Terminated: ok {rc=0} 08:52:51.433453 bus /sierra_3: Setting Powered False 08:52:52.532817 bus /sierra_3: Setting Powered False 08:52:53.647482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:52:54.902945 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:54.910062 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:52:54.943576 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:52:54.971268 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:52:55.026866 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:52:55.062452 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:52:55.089873 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:52:55.636742 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:52:55.687792 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:55.699644 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:52:55.769683 tst mo_mt_call.py: using LAC 32838 08:52:55.894414 tst mo_mt_call.py: using RAC 198 08:52:56.016803 tst mo_mt_call.py: using CellId 32838 08:52:56.138577 tst mo_mt_call.py: using BVCI 32839 08:52:56.253211 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:56.264597 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:56.275882 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:56.287143 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:56.298666 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:56.310160 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:52:56.427024 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:52:56.546584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:57.004298 run create_hlr_db(pid=28408): Launched 08:52:57.118414 bus /sierra_2: Setting Powered False 08:52:58.177698 run create_hlr_db(pid=28408): Terminated: ok {rc=0} 08:52:58.589122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28410): Launched 08:52:58.882572 run osmo-hlr_10.42.42.2(pid=28411): Launched 08:52:58.995512 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:59.516247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28413): Launched 08:52:59.811421 run osmo-stp_10.42.42.5(pid=28414): Launched 08:52:59.926011 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:00.458469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28416): Launched 08:53:00.753121 run osmo-msc_10.42.42.6(pid=28417): Launched 08:53:00.918806 run osmo-stp_10.42.42.5(pid=28414): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28414)] 08:53:01.196111 run osmo-stp_10.42.42.5(pid=28414): stdout: | (launched: 2022-12-13_08:52:59.757889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:01.434385 run osmo-stp_10.42.42.5(pid=28414): stderr: | 20221213085259929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085259929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085259929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085259930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085259930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085259930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085259930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:01.571033 run osmo-stp_10.42.42.5(pid=28414): stdout: | (launched: 2022-12-13_08:52:59.757889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:01.701823 run osmo-stp_10.42.42.5(pid=28414): stderr: | 20221213085259929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085259929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085259929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085259930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085259930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085259930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085259930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:01.863992 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28414): Process ended prematurely: osmo-stp_10.42.42.5(pid=28414) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28414)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:53:01.877673 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:53:01.913353 run osmo-hlr_10.42.42.2(pid=28411): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28411)] 08:53:01.975758 run osmo-hlr_10.42.42.2(pid=28411): stdout: | (launched: 2022-12-13_08:52:58.829578) 08:53:02.035985 run osmo-hlr_10.42.42.2(pid=28411): stderr: | 20221213085259004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085259004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085259004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085259004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085259004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085259004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085259016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085259024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085259025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085259025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:02.108496 run osmo-msc_10.42.42.6(pid=28417): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28417)] 08:53:02.160214 run osmo-msc_10.42.42.6(pid=28417): stdout: | (launched: 2022-12-13_08:53:00.700055) 08:53:02.213192 run osmo-msc_10.42.42.6(pid=28417): stderr: | 20221213085300984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085300984 DLGLOBAL DEBUG validating counter group 0x7fbb44c62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085300984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085300984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085300984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085300985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085300990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085300990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085300991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085300991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:02.268133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28410): Terminating (SIGTERM) 08:53:02.311523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28413): Terminating (SIGTERM) 08:53:02.359091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28416): Terminating (SIGTERM) 08:53:02.403523 --- ParallelTerminationStrategy: PID 28410 died... 08:53:02.424421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28410): Terminated: ok {rc=0} 08:53:02.472546 --- ParallelTerminationStrategy: PID 28413 died... 08:53:02.493280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28413): Terminated: ok {rc=0} 08:53:02.539761 --- ParallelTerminationStrategy: PID 28416 died... 08:53:02.559559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28416): Terminated: ok {rc=0} 08:53:02.646972 bus /sierra_3: Setting Powered False 08:53:03.744918 bus /sierra_3: Setting Powered False 08:53:04.859950 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:53:06.006381 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:53:06.018541 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:53:06.090339 tst mo_mt_call_osmux.py: using LAC 32839 08:53:06.216526 tst mo_mt_call_osmux.py: using RAC 199 08:53:06.333815 tst mo_mt_call_osmux.py: using CellId 32839 08:53:06.450329 tst mo_mt_call_osmux.py: using BVCI 32840 08:53:06.558931 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:53:06.569941 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:53:06.580679 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:53:06.591425 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:53:06.602802 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:53:06.613913 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:53:06.732513 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:53:06.850038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:07.309775 run create_hlr_db(pid=28419): Launched 08:53:07.422611 bus /sierra_2: Setting Powered False 08:53:08.482233 run create_hlr_db(pid=28419): Terminated: ok {rc=0} 08:53:08.914036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Launched 08:53:09.228850 run osmo-hlr_10.42.42.2(pid=28422): Launched 08:53:09.349086 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:09.892618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Launched 08:53:10.208634 run osmo-stp_10.42.42.5(pid=28425): Launched 08:53:10.329584 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:10.905259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28427): Launched 08:53:11.219938 run osmo-msc_10.42.42.6(pid=28428): Launched 08:53:11.396660 run osmo-stp_10.42.42.5(pid=28425): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] 08:53:11.529979 run osmo-stp_10.42.42.5(pid=28425): stdout: | (launched: 2022-12-13_08:53:10.151516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:11.664362 run osmo-stp_10.42.42.5(pid=28425): stderr: | 20221213085310346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085310347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085310347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085310347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085310348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085310348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085310348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:11.798542 run osmo-stp_10.42.42.5(pid=28425): stdout: | (launched: 2022-12-13_08:53:10.151516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:11.925599 run osmo-stp_10.42.42.5(pid=28425): stderr: | 20221213085310346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085310347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085310347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085310347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085310348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085310348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085310348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:12.076687 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28425): Process ended prematurely: osmo-stp_10.42.42.5(pid=28425) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:53:12.086485 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:53:12.114018 run osmo-hlr_10.42.42.2(pid=28422): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28422)] 08:53:12.163899 run osmo-hlr_10.42.42.2(pid=28422): stdout: | (launched: 2022-12-13_08:53:09.172228) 08:53:12.215304 run osmo-hlr_10.42.42.2(pid=28422): stderr: | 20221213085309372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085309372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085309372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085309372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085309372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085309372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085309384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085309395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085309395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085309395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:12.287018 run osmo-msc_10.42.42.6(pid=28428): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28428)] 08:53:12.336250 run osmo-msc_10.42.42.6(pid=28428): stdout: | (launched: 2022-12-13_08:53:11.163251) 08:53:12.387084 run osmo-msc_10.42.42.6(pid=28428): stderr: | 20221213085311484 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085311484 DLGLOBAL DEBUG validating counter group 0x7f378c19cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085311485 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085311485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085311485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085311485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085311487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085311487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085311487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085311487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:12.438131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Terminating (SIGTERM) 08:53:12.479120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Terminating (SIGTERM) 08:53:12.520459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28427): Terminating (SIGTERM) 08:53:12.561959 --- ParallelTerminationStrategy: PID 28421 died... 08:53:12.581539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Terminated: ok {rc=0} 08:53:12.627430 --- ParallelTerminationStrategy: PID 28424 died... 08:53:12.647111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Terminated: ok {rc=0} 08:53:12.692631 --- ParallelTerminationStrategy: PID 28427 died... 08:53:12.712271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28427): Terminated: ok {rc=0} 08:53:12.800254 bus /sierra_3: Setting Powered False 08:53:13.897257 bus /sierra_3: Setting Powered False 08:53:15.012301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:53:16.261227 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:16.272518 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:53:16.308907 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:53:16.339635 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:53:16.391480 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:53:16.426734 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:53:16.457180 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:53:17.009657 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:53:17.065290 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.078036 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:53:17.150655 tst mo_mt_call.py: using LAC 32840 08:53:17.269551 tst mo_mt_call.py: using RAC 200 08:53:17.390659 tst mo_mt_call.py: using CellId 32840 08:53:17.508537 tst mo_mt_call.py: using BVCI 32841 08:53:17.616224 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.627542 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.638580 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.649557 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.660867 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.672245 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:17.792109 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:17.907435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:18.365885 run create_hlr_db(pid=28433): Launched 08:53:18.477972 bus /sierra_2: Setting Powered False 08:53:19.537222 run create_hlr_db(pid=28433): Terminated: ok {rc=0} 08:53:19.970044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28435): Launched 08:53:20.285140 run osmo-hlr_10.42.42.2(pid=28436): Launched 08:53:20.407943 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:20.951788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28438): Launched 08:53:21.266689 run osmo-stp_10.42.42.5(pid=28439): Launched 08:53:21.387695 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:21.960823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28441): Launched 08:53:22.276931 run osmo-msc_10.42.42.6(pid=28442): Launched 08:53:22.453975 run osmo-stp_10.42.42.5(pid=28439): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28439)] 08:53:22.587301 run osmo-stp_10.42.42.5(pid=28439): stdout: | (launched: 2022-12-13_08:53:21.209937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:22.721465 run osmo-stp_10.42.42.5(pid=28439): stderr: | 20221213085321402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085321402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085321402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085321403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085321403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085321403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085321403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:22.855221 run osmo-stp_10.42.42.5(pid=28439): stdout: | (launched: 2022-12-13_08:53:21.209937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:22.981199 run osmo-stp_10.42.42.5(pid=28439): stderr: | 20221213085321402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085321402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085321402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085321403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085321403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085321403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085321403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:23.131949 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28439): Process ended prematurely: osmo-stp_10.42.42.5(pid=28439) [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28439)] [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:53:23.141516 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:53:23.168761 run osmo-hlr_10.42.42.2(pid=28436): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28436)] 08:53:23.218400 run osmo-hlr_10.42.42.2(pid=28436): stdout: | (launched: 2022-12-13_08:53:20.228338) 08:53:23.269781 run osmo-hlr_10.42.42.2(pid=28436): stderr: | 20221213085320428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085320428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085320428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085320428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085320428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085320428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085320441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085320449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085320449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085320449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:23.341388 run osmo-msc_10.42.42.6(pid=28442): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28442)] 08:53:23.390953 run osmo-msc_10.42.42.6(pid=28442): stdout: | (launched: 2022-12-13_08:53:22.219731) 08:53:23.442171 run osmo-msc_10.42.42.6(pid=28442): stderr: | 20221213085322542 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085322542 DLGLOBAL DEBUG validating counter group 0x7f20ffd73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085322542 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085322542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085322542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085322543 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085322544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085322545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085322545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085322545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:23.493849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28435): Terminating (SIGTERM) 08:53:23.535363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28438): Terminating (SIGTERM) 08:53:23.576820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28441): Terminating (SIGTERM) 08:53:23.618511 --- ParallelTerminationStrategy: PID 28435 died... 08:53:23.638325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28435): Terminated: ok {rc=0} 08:53:23.683888 --- ParallelTerminationStrategy: PID 28438 died... 08:53:23.703127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28438): Terminated: ok {rc=0} 08:53:23.749028 --- ParallelTerminationStrategy: PID 28441 died... 08:53:23.768305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28441): Terminated: ok {rc=0} 08:53:23.854311 bus /sierra_3: Setting Powered False 08:53:24.952195 bus /sierra_3: Setting Powered False 08:53:26.067986 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:53:27.211792 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:27.223596 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:53:27.294363 tst mo_mt_call_osmux.py: using LAC 32841 08:53:27.419667 tst mo_mt_call_osmux.py: using RAC 201 08:53:27.545341 tst mo_mt_call_osmux.py: using CellId 32841 08:53:27.668837 tst mo_mt_call_osmux.py: using BVCI 32842 08:53:27.785318 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:27.797114 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:27.808631 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:27.820115 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:27.831517 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:27.842906 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:27.958856 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:28.072643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:28.530984 run create_hlr_db(pid=28444): Launched 08:53:28.644153 bus /sierra_2: Setting Powered False 08:53:29.704046 run create_hlr_db(pid=28444): Terminated: ok {rc=0} 08:53:30.136655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28446): Launched 08:53:30.452775 run osmo-hlr_10.42.42.2(pid=28447): Launched 08:53:30.576060 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:31.150963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28449): Launched 08:53:31.473736 run osmo-stp_10.42.42.5(pid=28450): Launched 08:53:31.759820 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:32.372732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28452): Launched 08:53:32.683300 run osmo-msc_10.42.42.6(pid=28453): Launched 08:53:32.850469 run osmo-stp_10.42.42.5(pid=28450): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28450)] 08:53:32.977410 run osmo-stp_10.42.42.5(pid=28450): stdout: | (launched: 2022-12-13_08:53:31.403682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:33.103530 run osmo-stp_10.42.42.5(pid=28450): stderr: | 20221213085331676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085331676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085331676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085331676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085331677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085331677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085331677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:33.227213 run osmo-stp_10.42.42.5(pid=28450): stdout: | (launched: 2022-12-13_08:53:31.403682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:33.345471 run osmo-stp_10.42.42.5(pid=28450): stderr: | 20221213085331676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085331676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085331676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085331676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085331677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085331677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085331677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:33.486667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28450): Process ended prematurely: osmo-stp_10.42.42.5(pid=28450) [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28450)] [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:53:33.495364 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:53:33.521458 run osmo-hlr_10.42.42.2(pid=28447): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28447)] 08:53:33.569820 run osmo-hlr_10.42.42.2(pid=28447): stdout: | (launched: 2022-12-13_08:53:30.396006) 08:53:33.619579 run osmo-hlr_10.42.42.2(pid=28447): stderr: | 20221213085330592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085330592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085330592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085330592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085330592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085330592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085330603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085330611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085330612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085330612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:33.689286 run osmo-msc_10.42.42.6(pid=28453): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28453)] 08:53:33.736780 run osmo-msc_10.42.42.6(pid=28453): stdout: | (launched: 2022-12-13_08:53:32.629270) 08:53:33.786237 run osmo-msc_10.42.42.6(pid=28453): stderr: | 20221213085332899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085332899 DLGLOBAL DEBUG validating counter group 0x7f6443a63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085332899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085332900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085332900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085332900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085332902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085332902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085332902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085332902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:33.835849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28446): Terminating (SIGTERM) 08:53:33.875544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28449): Terminating (SIGTERM) 08:53:33.915510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28452): Terminating (SIGTERM) 08:53:33.955497 --- ParallelTerminationStrategy: PID 28446 died... 08:53:33.974898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28446): Terminated: ok {rc=0} 08:53:34.019240 --- ParallelTerminationStrategy: PID 28449 died... 08:53:34.038017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28449): Terminated: ok {rc=0} 08:53:34.081859 --- ParallelTerminationStrategy: PID 28452 died... 08:53:34.100688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28452): Terminated: ok {rc=0} 08:53:34.185927 bus /sierra_3: Setting Powered False 08:53:35.284412 bus /sierra_3: Setting Powered False 08:53:36.398650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:53:37.646094 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:37.651552 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:53:37.683811 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:53:37.711046 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:53:37.762820 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:53:37.796401 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:53:37.822881 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:53:38.369716 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:53:38.417852 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:38.428777 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:53:38.498141 tst mo_mt_call.py: using LAC 32842 08:53:38.615997 tst mo_mt_call.py: using RAC 202 08:53:38.732039 tst mo_mt_call.py: using CellId 32842 08:53:38.847625 tst mo_mt_call.py: using BVCI 32843 08:53:38.955014 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:38.966061 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:38.976659 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:38.987418 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:38.998649 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:39.009785 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:39.125114 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:39.244198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:39.733895 run create_hlr_db(pid=28459): Launched 08:53:39.863085 bus /sierra_2: Setting Powered False 08:53:40.925755 run create_hlr_db(pid=28459): Terminated: ok {rc=0} 08:53:41.365538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28461): Launched 08:53:41.680086 run osmo-hlr_10.42.42.2(pid=28462): Launched 08:53:41.800615 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:42.343854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28464): Launched 08:53:42.658794 run osmo-stp_10.42.42.5(pid=28465): Launched 08:53:42.779651 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:43.352475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28467): Launched 08:53:43.668483 run osmo-msc_10.42.42.6(pid=28468): Launched 08:53:43.845559 run osmo-stp_10.42.42.5(pid=28465): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28465)] 08:53:43.979175 run osmo-stp_10.42.42.5(pid=28465): stdout: | (launched: 2022-12-13_08:53:42.601984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:44.114340 run osmo-stp_10.42.42.5(pid=28465): stderr: | 20221213085342792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085342792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085342792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085342793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085342795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085342795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085342795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:44.248424 run osmo-stp_10.42.42.5(pid=28465): stdout: | (launched: 2022-12-13_08:53:42.601984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:44.374802 run osmo-stp_10.42.42.5(pid=28465): stderr: | 20221213085342792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085342792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085342792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085342793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085342795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085342795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085342795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:44.526106 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28465): Process ended prematurely: osmo-stp_10.42.42.5(pid=28465) [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28465)] [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:53:44.536080 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:53:44.563783 run osmo-hlr_10.42.42.2(pid=28462): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28462)] 08:53:44.613667 run osmo-hlr_10.42.42.2(pid=28462): stdout: | (launched: 2022-12-13_08:53:41.623260) 08:53:44.665116 run osmo-hlr_10.42.42.2(pid=28462): stderr: | 20221213085341822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085341822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085341822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085341823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085341823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085341823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085341837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085341845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085341845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085341845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:44.737264 run osmo-msc_10.42.42.6(pid=28468): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28468)] 08:53:44.787452 run osmo-msc_10.42.42.6(pid=28468): stdout: | (launched: 2022-12-13_08:53:43.610629) 08:53:44.839212 run osmo-msc_10.42.42.6(pid=28468): stderr: | 20221213085343934 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085343934 DLGLOBAL DEBUG validating counter group 0x7fb36533cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085343934 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085343934 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085343934 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085343934 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085343936 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085343936 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085343937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085343937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:44.891218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28461): Terminating (SIGTERM) 08:53:44.932754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28464): Terminating (SIGTERM) 08:53:44.974372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28467): Terminating (SIGTERM) 08:53:45.016345 --- ParallelTerminationStrategy: PID 28461 died... 08:53:45.036020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28461): Terminated: ok {rc=0} 08:53:45.082409 --- ParallelTerminationStrategy: PID 28464 died... 08:53:45.102081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28464): Terminated: ok {rc=0} 08:53:45.148068 --- ParallelTerminationStrategy: PID 28467 died... 08:53:45.167617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28467): Terminated: ok {rc=0} 08:53:45.255159 bus /sierra_3: Setting Powered False 08:53:46.361297 bus /sierra_3: Setting Powered False 08:53:47.499718 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:53:48.668771 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:48.681856 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:53:48.757038 tst mo_mt_call_osmux.py: using LAC 32843 08:53:48.884390 tst mo_mt_call_osmux.py: using RAC 203 08:53:49.011468 tst mo_mt_call_osmux.py: using CellId 32843 08:53:49.140177 tst mo_mt_call_osmux.py: using BVCI 32844 08:53:49.258641 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:49.271392 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:49.284220 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:49.296453 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:49.308941 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:49.322731 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:49.448937 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:49.575046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:50.085181 run create_hlr_db(pid=28740): Launched 08:53:50.251143 bus /sierra_2: Setting Powered False 08:53:51.312199 run create_hlr_db(pid=28740): Terminated: ok {rc=0} 08:53:51.765948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28744): Launched 08:53:52.095955 run osmo-hlr_10.42.42.2(pid=28745): Launched 08:53:52.339925 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:52.995141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28747): Launched 08:53:53.337706 run osmo-stp_10.42.42.5(pid=28748): Launched 08:53:53.581677 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:54.249728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28750): Launched 08:53:54.593686 run osmo-msc_10.42.42.6(pid=28751): Launched 08:53:54.947948 run osmo-stp_10.42.42.5(pid=28748): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28748)] 08:53:55.216434 run osmo-stp_10.42.42.5(pid=28748): stdout: | (launched: 2022-12-13_08:53:53.268649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:55.401151 run osmo-stp_10.42.42.5(pid=28748): stderr: | 20221213085353564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085353573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085353573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085353574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085353574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085353574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085353574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:55.536871 run osmo-stp_10.42.42.5(pid=28748): stdout: | (launched: 2022-12-13_08:53:53.268649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:55.667030 run osmo-stp_10.42.42.5(pid=28748): stderr: | 20221213085353564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085353573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085353573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085353574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085353574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085353574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085353574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:55.822926 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28748): Process ended prematurely: osmo-stp_10.42.42.5(pid=28748) [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28748)] [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:53:55.833675 tst mo_mt_call_osmux.py:8: Test FAILED (7.2 sec) 08:53:55.862784 run osmo-hlr_10.42.42.2(pid=28745): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28745)] 08:53:55.914912 run osmo-hlr_10.42.42.2(pid=28745): stdout: | (launched: 2022-12-13_08:53:52.030598) 08:53:55.968490 run osmo-hlr_10.42.42.2(pid=28745): stderr: | 20221213085352335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085352335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085352335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085352335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085352335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085352335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085352355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085352367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085352368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085352368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:56.042775 run osmo-msc_10.42.42.6(pid=28751): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28751)] 08:53:56.094140 run osmo-msc_10.42.42.6(pid=28751): stdout: | (launched: 2022-12-13_08:53:54.521635) 08:53:56.148554 run osmo-msc_10.42.42.6(pid=28751): stderr: | 20221213085355027 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085355027 DLGLOBAL DEBUG validating counter group 0x7f72bcf36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085355027 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085355027 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085355027 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085355027 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085355037 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085355038 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085355038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085355038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:56.202657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28744): Terminating (SIGTERM) 08:53:56.245903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28747): Terminating (SIGTERM) 08:53:56.290832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28750): Terminating (SIGTERM) 08:53:56.336237 --- ParallelTerminationStrategy: PID 28744 died... 08:53:56.357264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28744): Terminated: ok {rc=0} 08:53:56.405771 --- ParallelTerminationStrategy: PID 28747 died... 08:53:56.426144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28747): Terminated: ok {rc=0} 08:53:56.473418 --- ParallelTerminationStrategy: PID 28750 died... 08:53:56.493989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28750): Terminated: ok {rc=0} 08:53:56.584028 bus /sierra_3: Setting Powered False 08:53:57.687392 bus /sierra_3: Setting Powered False 08:53:58.810363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 08:54:00.074306 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:00.080538 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 08:54:00.116570 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 08:54:00.146514 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 08:54:00.199123 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 08:54:00.234773 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 08:54:00.263960 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 08:54:00.813076 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 08:54:00.876012 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:00.889749 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:54:00.964550 tst mo_mt_call.py: using LAC 32844 08:54:01.094148 tst mo_mt_call.py: using RAC 204 08:54:01.247173 tst mo_mt_call.py: using CellId 32844 08:54:01.432912 tst mo_mt_call.py: using BVCI 32845 08:54:01.564715 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:01.576789 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:01.588504 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:01.600343 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:01.612201 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:01.624203 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:54:01.755892 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:54:01.917081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:02.502373 run create_hlr_db(pid=28756): Launched 08:54:02.675743 bus /sierra_2: Setting Powered False 08:54:03.740823 run create_hlr_db(pid=28756): Terminated: ok {rc=0} 08:54:04.221191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28758): Launched 08:54:04.575590 run osmo-hlr_10.42.42.2(pid=28759): Launched 08:54:04.821574 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:05.497846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28761): Launched 08:54:05.841052 run osmo-stp_10.42.42.5(pid=28762): Launched 08:54:06.086644 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:06.769819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28764): Launched 08:54:07.113664 run osmo-msc_10.42.42.6(pid=28765): Launched 08:54:07.479656 run osmo-stp_10.42.42.5(pid=28762): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28762)] 08:54:07.767555 run osmo-stp_10.42.42.5(pid=28762): stdout: | (launched: 2022-12-13_08:54:05.773187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:07.946478 run osmo-stp_10.42.42.5(pid=28762): stderr: | 20221213085406075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085406075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085406076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085406076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085406077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085406077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085406077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:08.082812 run osmo-stp_10.42.42.5(pid=28762): stdout: | (launched: 2022-12-13_08:54:05.773187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:08.213081 run osmo-stp_10.42.42.5(pid=28762): stderr: | 20221213085406075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085406075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085406076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085406076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085406077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085406077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085406077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:08.371952 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28762): Process ended prematurely: osmo-stp_10.42.42.5(pid=28762) [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28762)] [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 08:54:08.382725 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 08:54:08.411412 run osmo-hlr_10.42.42.2(pid=28759): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28759)] 08:54:08.463362 run osmo-hlr_10.42.42.2(pid=28759): stdout: | (launched: 2022-12-13_08:54:04.500727) 08:54:08.516510 run osmo-hlr_10.42.42.2(pid=28759): stderr: | 20221213085404815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085404815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085404815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085404815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085404815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085404815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085404835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085404847 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085404848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085404848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:08.592327 run osmo-msc_10.42.42.6(pid=28765): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28765)] 08:54:08.643557 run osmo-msc_10.42.42.6(pid=28765): stdout: | (launched: 2022-12-13_08:54:07.045468) 08:54:08.697215 run osmo-msc_10.42.42.6(pid=28765): stderr: | 20221213085407561 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085407561 DLGLOBAL DEBUG validating counter group 0x7f8072017c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085407561 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085407561 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085407562 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085407562 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085407563 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085407564 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085407564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085407564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:08.752421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28758): Terminating (SIGTERM) 08:54:08.796328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28761): Terminating (SIGTERM) 08:54:08.841614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28764): Terminating (SIGTERM) 08:54:08.887118 --- ParallelTerminationStrategy: PID 28758 died... 08:54:08.908079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28758): Terminated: ok {rc=0} 08:54:08.958085 --- ParallelTerminationStrategy: PID 28761 died... 08:54:08.979038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28761): Terminated: ok {rc=0} 08:54:09.026722 --- ParallelTerminationStrategy: PID 28764 died... 08:54:09.047818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28764): Terminated: ok {rc=0} 08:54:09.139054 bus /sierra_3: Setting Powered False 08:54:10.237692 bus /sierra_3: Setting Powered False 08:54:11.351757 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 08:54:12.503046 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:12.515095 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:54:12.566126 tst mo_mt_call_osmux.py: using LAC 32845 08:54:12.682975 tst mo_mt_call_osmux.py: using RAC 205 08:54:12.799567 tst mo_mt_call_osmux.py: using CellId 32845 08:54:12.916737 tst mo_mt_call_osmux.py: using BVCI 32846 08:54:13.024205 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:13.035161 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:13.045797 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:13.056471 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:13.067173 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:54:13.079456 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:54:13.199814 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:54:13.316825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:13.809051 run create_hlr_db(pid=28768): Launched 08:54:13.938219 bus /sierra_2: Setting Powered False 08:54:15.000731 run create_hlr_db(pid=28768): Terminated: ok {rc=0} 08:54:15.440891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Launched 08:54:15.757342 run osmo-hlr_10.42.42.2(pid=28771): Launched 08:54:15.878336 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:16.487936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Launched 08:54:16.838894 run osmo-stp_10.42.42.5(pid=28774): Launched 08:54:17.080483 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:17.728334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Launched 08:54:18.044087 run osmo-msc_10.42.42.6(pid=28777): Launched 08:54:18.220357 run osmo-stp_10.42.42.5(pid=28774): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] 08:54:18.354380 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-13_08:54:16.775153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:18.488579 run osmo-stp_10.42.42.5(pid=28774): stderr: | 20221213085417070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085417070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085417070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085417071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085417071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085417071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085417071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:18.622438 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-13_08:54:16.775153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:18.748685 run osmo-stp_10.42.42.5(pid=28774): stderr: | 20221213085417070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085417070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085417070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085417071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085417071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085417071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085417071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:18.900261 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 08:54:18.909935 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:54:18.937255 run osmo-hlr_10.42.42.2(pid=28771): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28771)] 08:54:18.986934 run osmo-hlr_10.42.42.2(pid=28771): stdout: | (launched: 2022-12-13_08:54:15.700083) 08:54:19.038166 run osmo-hlr_10.42.42.2(pid=28771): stderr: | 20221213085415897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085415897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085415897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085415897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085415897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085415897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085415909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085415917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085415918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085415918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:19.109462 run osmo-msc_10.42.42.6(pid=28777): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28777)] 08:54:19.158969 run osmo-msc_10.42.42.6(pid=28777): stdout: | (launched: 2022-12-13_08:54:17.987089) 08:54:19.210598 run osmo-msc_10.42.42.6(pid=28777): stderr: | 20221213085418307 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085418307 DLGLOBAL DEBUG validating counter group 0x7f3c95e05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085418307 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085418308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085418308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085418308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085418310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085418310 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085418310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085418310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:19.262142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminating (SIGTERM) 08:54:19.303402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminating (SIGTERM) 08:54:19.344874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminating (SIGTERM) 08:54:19.387116 --- ParallelTerminationStrategy: PID 28770 died... 08:54:19.407022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminated: ok {rc=0} 08:54:19.452721 --- ParallelTerminationStrategy: PID 28773 died... 08:54:19.472255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminated: ok {rc=0} 08:54:19.517867 --- ParallelTerminationStrategy: PID 28776 died... 08:54:19.537283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminated: ok {rc=0} 08:54:19.624169 bus /sierra_3: Setting Powered False 08:54:20.722917 bus /sierra_3: Setting Powered False 08:54:21.838020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:54:23.085636 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:23.092211 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:54:23.125686 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:54:23.153207 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:54:23.204607 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:54:23.238449 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:54:23.265827 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:54:23.820449 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:54:23.872378 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:23.884234 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:54:23.939045 tst mo_mt_call.py: using LAC 32846 08:54:24.065043 tst mo_mt_call.py: using RAC 206 08:54:24.189061 tst mo_mt_call.py: using CellId 32846 08:54:24.312775 tst mo_mt_call.py: using BVCI 32847 08:54:24.428148 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:24.439796 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:24.451254 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:24.462697 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:24.474243 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:24.485720 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:54:24.602392 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:54:24.722182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:25.213754 run create_hlr_db(pid=28782): Launched 08:54:25.342950 bus /sierra_2: Setting Powered False 08:54:26.406196 run create_hlr_db(pid=28782): Terminated: ok {rc=0} 08:54:26.830035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Launched 08:54:27.124838 run osmo-hlr_10.42.42.2(pid=28785): Launched 08:54:27.238121 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:27.764932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Launched 08:54:28.062127 run osmo-stp_10.42.42.5(pid=28788): Launched 08:54:28.175798 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:28.714355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Launched 08:54:29.009972 run osmo-msc_10.42.42.6(pid=28791): Launched 08:54:29.176189 run osmo-stp_10.42.42.5(pid=28788): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] 08:54:29.302825 run osmo-stp_10.42.42.5(pid=28788): stdout: | (launched: 2022-12-13_08:54:28.008256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:29.429514 run osmo-stp_10.42.42.5(pid=28788): stderr: | 20221213085428177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085428177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085428177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085428177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085428178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085428178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085428178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:29.553393 run osmo-stp_10.42.42.5(pid=28788): stdout: | (launched: 2022-12-13_08:54:28.008256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:29.671819 run osmo-stp_10.42.42.5(pid=28788): stderr: | 20221213085428177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085428177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085428177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085428177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085428178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085428178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085428178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:29.813603 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28788): Process ended prematurely: osmo-stp_10.42.42.5(pid=28788) [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:54:29.822507 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:54:29.848345 run osmo-hlr_10.42.42.2(pid=28785): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28785)] 08:54:29.896703 run osmo-hlr_10.42.42.2(pid=28785): stdout: | (launched: 2022-12-13_08:54:27.071669) 08:54:29.946229 run osmo-hlr_10.42.42.2(pid=28785): stderr: | 20221213085427248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085427248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085427248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085427248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085427248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085427249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085427262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085427270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085427270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085427270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:30.015834 run osmo-msc_10.42.42.6(pid=28791): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28791)] 08:54:30.063063 run osmo-msc_10.42.42.6(pid=28791): stdout: | (launched: 2022-12-13_08:54:28.956010) 08:54:30.112212 run osmo-msc_10.42.42.6(pid=28791): stderr: | 20221213085429228 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085429228 DLGLOBAL DEBUG validating counter group 0x7f9590245c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085429228 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085429228 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085429229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085429229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085429231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085429231 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085429231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085429231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:30.161850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminating (SIGTERM) 08:54:30.201257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminating (SIGTERM) 08:54:30.240722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Terminating (SIGTERM) 08:54:30.280864 --- ParallelTerminationStrategy: PID 28784 died... 08:54:30.300093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminated: ok {rc=0} 08:54:30.344020 --- ParallelTerminationStrategy: PID 28787 died... 08:54:30.362811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminated: ok {rc=0} 08:54:30.406660 --- ParallelTerminationStrategy: PID 28790 died... 08:54:30.425351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Terminated: ok {rc=0} 08:54:30.511648 bus /sierra_3: Setting Powered False 08:54:31.607790 bus /sierra_3: Setting Powered False 08:54:32.724748 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:54:33.870017 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:33.881803 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:54:33.934442 tst mo_mt_call_osmux.py: using LAC 32847 08:54:34.053193 tst mo_mt_call_osmux.py: using RAC 207 08:54:34.179361 tst mo_mt_call_osmux.py: using CellId 32847 08:54:34.304583 tst mo_mt_call_osmux.py: using BVCI 32848 08:54:34.419917 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:34.431730 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:34.443330 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:34.454880 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:34.466508 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:54:34.478277 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:54:34.596167 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:54:34.716709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:35.175015 run create_hlr_db(pid=28793): Launched 08:54:35.288581 bus /sierra_2: Setting Powered False 08:54:36.348262 run create_hlr_db(pid=28793): Terminated: ok {rc=0} 08:54:36.780843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28795): Launched 08:54:37.095775 run osmo-hlr_10.42.42.2(pid=28796): Launched 08:54:37.217773 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:37.762370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28798): Launched 08:54:38.076935 run osmo-stp_10.42.42.5(pid=28799): Launched 08:54:38.196923 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:38.768905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28801): Launched 08:54:39.082916 run osmo-msc_10.42.42.6(pid=28802): Launched 08:54:39.259074 run osmo-stp_10.42.42.5(pid=28799): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28799)] 08:54:39.392322 run osmo-stp_10.42.42.5(pid=28799): stdout: | (launched: 2022-12-13_08:54:38.020193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:39.525810 run osmo-stp_10.42.42.5(pid=28799): stderr: | 20221213085438211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085438211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085438212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085438212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085438212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085438213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085438213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:39.658488 run osmo-stp_10.42.42.5(pid=28799): stdout: | (launched: 2022-12-13_08:54:38.020193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:39.784173 run osmo-stp_10.42.42.5(pid=28799): stderr: | 20221213085438211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085438211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085438212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085438212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085438212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085438213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085438213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:39.934678 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28799): Process ended prematurely: osmo-stp_10.42.42.5(pid=28799) [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28799)] [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:54:39.943999 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:54:39.971255 run osmo-hlr_10.42.42.2(pid=28796): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28796)] 08:54:40.020890 run osmo-hlr_10.42.42.2(pid=28796): stdout: | (launched: 2022-12-13_08:54:37.039277) 08:54:40.072108 run osmo-hlr_10.42.42.2(pid=28796): stderr: | 20221213085437239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085437239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085437239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085437239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085437239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085437239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085437252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085437262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085437262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085437262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:40.143594 run osmo-msc_10.42.42.6(pid=28802): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28802)] 08:54:40.192838 run osmo-msc_10.42.42.6(pid=28802): stdout: | (launched: 2022-12-13_08:54:39.026314) 08:54:40.243710 run osmo-msc_10.42.42.6(pid=28802): stderr: | 20221213085439347 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085439348 DLGLOBAL DEBUG validating counter group 0x7f396e580c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085439348 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085439348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085439348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085439349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085439351 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085439351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085439351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085439351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:40.294977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28795): Terminating (SIGTERM) 08:54:40.336063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28798): Terminating (SIGTERM) 08:54:40.377059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28801): Terminating (SIGTERM) 08:54:40.418324 --- ParallelTerminationStrategy: PID 28795 died... 08:54:40.438196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28795): Terminated: ok {rc=0} 08:54:40.483600 --- ParallelTerminationStrategy: PID 28798 died... 08:54:40.502742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28798): Terminated: ok {rc=0} 08:54:40.548471 --- ParallelTerminationStrategy: PID 28801 died... 08:54:40.568124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28801): Terminated: ok {rc=0} 08:54:40.654895 bus /sierra_3: Setting Powered False 08:54:41.752761 bus /sierra_3: Setting Powered False 08:54:42.868293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:trx-b200 --------------------------------------------------------------------- 08:54:44.119767 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:44.124261 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 08:54:44.157672 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:54:44.185154 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 08:54:44.270255 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 08:54:44.303844 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:54:44.331173 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 08:54:44.917363 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 08:54:44.922428 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:44.933477 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:54:44.983347 tst emergency_mo_mt_call.py: using LAC 32848 08:54:45.109231 tst emergency_mo_mt_call.py: using RAC 208 08:54:45.230741 tst emergency_mo_mt_call.py: using CellId 32848 08:54:45.351334 tst emergency_mo_mt_call.py: using BVCI 32849 08:54:45.463986 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:45.475077 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:45.485971 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:45.496732 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:45.507593 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:45.518448 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:54:45.634155 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:54:45.750034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:46.314060 run create_hlr_db(pid=28808): Launched 08:54:46.462911 bus /sierra_2: Setting Powered False 08:54:47.521177 run create_hlr_db(pid=28808): Terminated: ok {rc=0} 08:54:47.961107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28810): Launched 08:54:48.271455 run osmo-hlr_10.42.42.2(pid=28811): Launched 08:54:48.390925 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:48.928075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28813): Launched 08:54:49.238115 run osmo-stp_10.42.42.5(pid=28814): Launched 08:54:49.367331 tst emergency_mo_mt_call.py: using MSISDN 8074 08:54:49.527192 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:50.087351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28816): Launched 08:54:50.397535 run osmo-msc_10.42.42.6(pid=28817): Launched 08:54:50.571268 run osmo-stp_10.42.42.5(pid=28814): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28814)] 08:54:50.703951 run osmo-stp_10.42.42.5(pid=28814): stdout: | (launched: 2022-12-13_08:54:49.181981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:50.836780 run osmo-stp_10.42.42.5(pid=28814): stderr: | 20221213085449373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085449373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085449374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085449374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085449375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085449375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085449375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:50.967504 run osmo-stp_10.42.42.5(pid=28814): stdout: | (launched: 2022-12-13_08:54:49.181981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:51.091232 run osmo-stp_10.42.42.5(pid=28814): stderr: | 20221213085449373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085449373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085449374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085449374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085449375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085449375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085449375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:51.239487 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28814): Process ended prematurely: osmo-stp_10.42.42.5(pid=28814) [trial-2387↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28814)] [trial-2387↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 08:54:51.248319 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 08:54:51.274998 run osmo-hlr_10.42.42.2(pid=28811): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28811)] 08:54:51.325314 run osmo-hlr_10.42.42.2(pid=28811): stdout: | (launched: 2022-12-13_08:54:48.215601) 08:54:51.376587 run osmo-hlr_10.42.42.2(pid=28811): stderr: | 20221213085448410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085448410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085448410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085448410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085448411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085448411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085448476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085448487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085448487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085448487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:51.448156 run osmo-msc_10.42.42.6(pid=28817): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28817)] 08:54:51.497527 run osmo-msc_10.42.42.6(pid=28817): stdout: | (launched: 2022-12-13_08:54:50.341365) 08:54:51.548414 run osmo-msc_10.42.42.6(pid=28817): stderr: | 20221213085450662 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085450662 DLGLOBAL DEBUG validating counter group 0x7fcf0cab5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085450662 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085450662 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085450662 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085450663 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085450664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085450665 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085450665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085450665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:51.599744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28810): Terminating (SIGTERM) 08:54:51.640550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28813): Terminating (SIGTERM) 08:54:51.681802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28816): Terminating (SIGTERM) 08:54:51.723113 --- ParallelTerminationStrategy: PID 28810 died... 08:54:51.742937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28810): Terminated: ok {rc=0} 08:54:51.788800 --- ParallelTerminationStrategy: PID 28813 died... 08:54:51.808082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28813): Terminated: ok {rc=0} 08:54:51.853616 --- ParallelTerminationStrategy: PID 28816 died... 08:54:51.872852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28816): Terminated: ok {rc=0} 08:54:51.958958 bus /sierra_3: Setting Powered False 08:54:53.055647 bus /sierra_3: Setting Powered False 08:54:54.169084 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 08:54:55.255152 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:55.266609 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:54:55.316405 tst emergency_preemptive_call.py: using LAC 32849 08:54:55.432403 tst emergency_preemptive_call.py: using RAC 209 08:54:55.547107 tst emergency_preemptive_call.py: using CellId 32849 08:54:55.662577 tst emergency_preemptive_call.py: using BVCI 32850 08:54:55.776480 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:55.787689 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:55.798695 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:55.809787 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:55.820790 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:54:55.831966 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:54:55.951407 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:54:56.067408 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:54:56.183792 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:54:56.299628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:56.784353 run create_hlr_db(pid=28819): Launched 08:54:56.910873 bus /sierra_2: Setting Powered False 08:54:57.972522 run create_hlr_db(pid=28819): Terminated: ok {rc=0} 08:54:58.388773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28821): Launched 08:54:58.679171 run osmo-hlr_10.42.42.2(pid=28822): Launched 08:54:58.789851 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:59.301477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28824): Launched 08:54:59.591849 run osmo-stp_10.42.42.5(pid=28825): Launched 08:54:59.712546 tst emergency_preemptive_call.py: using MSISDN 8075 08:54:59.875396 run osmo-msc_10.42.42.6: Starting osmo-msc 08:55:00.394748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28827): Launched 08:55:00.687695 run osmo-msc_10.42.42.6(pid=28828): Launched 08:55:00.849865 run osmo-stp_10.42.42.5(pid=28825): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28825)] 08:55:01.051601 run osmo-stp_10.42.42.5(pid=28825): stdout: | (launched: 2022-12-13_08:54:59.539056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:01.222288 run osmo-stp_10.42.42.5(pid=28825): stderr: | 20221213085459707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085459707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085459707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085459708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085459708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085459708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085459708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:01.358101 run osmo-stp_10.42.42.5(pid=28825): stdout: | (launched: 2022-12-13_08:54:59.539056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:01.488733 run osmo-stp_10.42.42.5(pid=28825): stderr: | 20221213085459707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085459707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085459707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085459708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085459708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085459708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085459708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:01.644238 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28825): Process ended prematurely: osmo-stp_10.42.42.5(pid=28825) [trial-2387↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28825)] [trial-2387↪emergency:trx-b200↪emergency_preemptive_call.py:32] 08:55:01.655124 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 08:55:01.693552 run osmo-hlr_10.42.42.2(pid=28822): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28822)] 08:55:01.747719 run osmo-hlr_10.42.42.2(pid=28822): stdout: | (launched: 2022-12-13_08:54:58.626086) 08:55:01.802250 run osmo-hlr_10.42.42.2(pid=28822): stderr: | 20221213085458801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085458801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085458802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085458802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085458802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085458802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085458815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085458823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085458823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085458823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:01.876891 run osmo-msc_10.42.42.6(pid=28828): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28828)] 08:55:01.928895 run osmo-msc_10.42.42.6(pid=28828): stdout: | (launched: 2022-12-13_08:55:00.630667) 08:55:01.983509 run osmo-msc_10.42.42.6(pid=28828): stderr: | 20221213085500904 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213085500904 DLGLOBAL DEBUG validating counter group 0x7fa847aa7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213085500905 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213085500905 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213085500905 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213085500905 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213085500908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213085500909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213085500909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213085500909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:55:02.036735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28821): Terminating (SIGTERM) 08:55:02.080217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28824): Terminating (SIGTERM) 08:55:02.125236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28827): Terminating (SIGTERM) 08:55:02.171625 --- ParallelTerminationStrategy: PID 28821 died... 08:55:02.192576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28821): Terminated: ok {rc=0} 08:55:02.241376 --- ParallelTerminationStrategy: PID 28824 died... 08:55:02.261904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28824): Terminated: ok {rc=0} 08:55:02.309414 --- ParallelTerminationStrategy: PID 28827 died... 08:55:02.329882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28827): Terminated: ok {rc=0} 08:55:02.421720 bus /sierra_9: Setting Powered False 08:55:03.521711 bus /sierra_9: Setting Powered False 08:55:04.637598 bus /sierra_8: Setting Powered False 08:55:05.736531 bus /sierra_8: Setting Powered False 08:55:06.849546 bus /sierra_3: Setting Powered False 08:55:07.945984 bus /sierra_3: Setting Powered False 08:55:09.061991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-b200 --------------------------------------------------------------------- 08:55:10.345087 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:55:10.349916 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 08:55:10.383162 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 08:55:10.422454 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 08:55:10.510148 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 08:55:10.544113 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 08:55:10.583633 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 08:55:11.174494 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 08:55:11.226386 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.237576 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:55:11.286765 tst cs_paging_gprs_active.py: using LAC 32850 08:55:11.412208 tst cs_paging_gprs_active.py: using RAC 210 08:55:11.538187 tst cs_paging_gprs_active.py: using CellId 32850 08:55:11.664340 tst cs_paging_gprs_active.py: using BVCI 32851 08:55:11.774028 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.784543 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.794993 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.805274 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.815379 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.825796 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.836333 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.846737 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:11.857381 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:11.972847 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:12.091803 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:55:12.306717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:12.624172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28836): Launched 08:55:12.900912 run iperf3-srv_10.42.42.10(pid=28837): Launched 08:55:13.020619 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:55:13.235195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:13.554333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28838): Launched 08:55:13.830007 run iperf3-srv_10.42.42.10(pid=28839): Launched 08:55:13.949465 tst cs_paging_gprs_active.py:38: start network... 08:55:14.163630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:14.656202 run create_hlr_db(pid=28840): Launched 08:55:14.786807 bus /sierra_2: Setting Powered False 08:55:15.850019 run create_hlr_db(pid=28840): Terminated: ok {rc=0} 08:55:16.315189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28842): Launched 08:55:16.650962 run osmo-hlr_10.42.42.2(pid=28843): Launched 08:55:16.911302 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:17.617509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28845): Launched 08:55:17.914273 run osmo-stp_10.42.42.5(pid=28846): Launched 08:55:18.028235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:18.542210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28848): Launched 08:55:18.655987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:18.906973 run patchelf(pid=28849): Launched 08:55:19.072072 run osmo-stp_10.42.42.5(pid=28846): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28846)] 08:55:19.198761 run osmo-stp_10.42.42.5(pid=28846): stdout: | (launched: 2022-12-13_08:55:17.860533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:19.326400 run osmo-stp_10.42.42.5(pid=28846): stderr: | 20221213085518028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085518028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085518028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085518029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085518031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085518031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085518031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:19.454276 run osmo-stp_10.42.42.5(pid=28846): stdout: | (launched: 2022-12-13_08:55:17.860533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:19.576204 run osmo-stp_10.42.42.5(pid=28846): stderr: | 20221213085518028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085518028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085518028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085518029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085518031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085518031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085518031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:19.720610 run patchelf(pid=28849): Terminating (SIGINT) 08:55:19.887292 run patchelf(pid=28849): Terminated: ok {rc=0} 08:55:20.008052 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28846): Process ended prematurely: osmo-stp_10.42.42.5(pid=28846) [trial-2387↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28846)] [trial-2387↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 08:55:20.017640 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:55:20.044348 run osmo-hlr_10.42.42.2(pid=28843): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28843)] 08:55:20.092153 run osmo-hlr_10.42.42.2(pid=28843): stdout: | (launched: 2022-12-13_08:55:16.580135) 08:55:20.141222 run osmo-hlr_10.42.42.2(pid=28843): stderr: | 20221213085517004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085517004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085517004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085517004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085517004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085517004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085517031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085517057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085517061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085517061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:20.190601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28836): Terminating (SIGTERM) 08:55:20.230373 run iperf3-srv_10.42.42.10(pid=28837): Terminating (SIGTERM) 08:55:20.270154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28838): Terminating (SIGTERM) 08:55:20.309810 run iperf3-srv_10.42.42.10(pid=28839): Terminating (SIGTERM) 08:55:20.349397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28842): Terminating (SIGTERM) 08:55:20.389039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28845): Terminating (SIGTERM) 08:55:20.428670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28848): Terminating (SIGTERM) 08:55:20.469132 --- ParallelTerminationStrategy: PID 28836 died... 08:55:20.488463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28836): Terminated: ok {rc=0} 08:55:20.532797 --- ParallelTerminationStrategy: PID 28837 died... 08:55:20.551610 run iperf3-srv_10.42.42.10(pid=28837): Terminated {rc=256} 08:55:20.595138 --- ParallelTerminationStrategy: PID 28838 died... 08:55:20.613724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28838): Terminated: ok {rc=0} 08:55:20.657093 --- ParallelTerminationStrategy: PID 28839 died... 08:55:20.675698 run iperf3-srv_10.42.42.10(pid=28839): Terminated {rc=256} 08:55:20.719099 --- ParallelTerminationStrategy: PID 28842 died... 08:55:20.737782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28842): Terminated: ok {rc=0} 08:55:20.781205 --- ParallelTerminationStrategy: PID 28845 died... 08:55:20.799884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28845): Terminated: ok {rc=0} 08:55:20.843665 --- ParallelTerminationStrategy: PID 28848 died... 08:55:20.862512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28848): Terminated: ok {rc=0} 08:55:20.947914 bus /gobi_0: Setting Powered False 08:55:22.047411 bus /gobi_0: Setting Powered False 08:55:23.158584 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200 iperf3.py ---------------------------------------------- 08:55:24.304779 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.316411 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:55:24.368534 tst iperf3.py: using LAC 32851 08:55:24.486638 tst iperf3.py: using RAC 211 08:55:24.605406 tst iperf3.py: using CellId 32851 08:55:24.723749 tst iperf3.py: using BVCI 32852 08:55:24.832901 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.843536 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.853850 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.863969 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.874492 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.884886 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.896484 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.907579 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:24.918207 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:25.033368 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:55:25.233829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:25.532042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28850): Launched 08:55:25.789992 run iperf3-srv_10.42.42.10(pid=28851): Launched 08:55:25.901539 tst iperf3.py:8: start network... 08:55:26.100461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:26.558400 run create_hlr_db(pid=28852): Launched 08:55:26.671137 bus /gobi_6: Setting Powered False 08:55:27.730107 run create_hlr_db(pid=28852): Terminated: ok {rc=0} 08:55:28.161495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28854): Launched 08:55:28.477117 run osmo-hlr_10.42.42.2(pid=28855): Launched 08:55:28.598960 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:29.146550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28857): Launched 08:55:29.463120 run osmo-stp_10.42.42.5(pid=28858): Launched 08:55:29.585259 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:30.132677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28860): Launched 08:55:30.253619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:30.520129 run patchelf(pid=28861): Launched 08:55:30.697078 run osmo-stp_10.42.42.5(pid=28858): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28858)] 08:55:30.831591 run osmo-stp_10.42.42.5(pid=28858): stdout: | (launched: 2022-12-13_08:55:29.405947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:30.979170 run osmo-stp_10.42.42.5(pid=28858): stderr: | 20221213085529596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085529596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085529597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085529597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085529599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085529600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085529600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:31.116613 run osmo-stp_10.42.42.5(pid=28858): stdout: | (launched: 2022-12-13_08:55:29.405947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:31.250343 run osmo-stp_10.42.42.5(pid=28858): stderr: | 20221213085529596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085529596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085529597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085529597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085529599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085529600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085529600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:31.407385 run patchelf(pid=28861): Terminating (SIGINT) 08:55:31.588675 run patchelf(pid=28861): Terminated: ok {rc=0} 08:55:31.719430 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28858): Process ended prematurely: osmo-stp_10.42.42.5(pid=28858) [trial-2387↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28858)] [trial-2387↪gprs:trx-b200↪iperf3.py:8] 08:55:31.730150 tst iperf3.py:8: Test FAILED (7.5 sec) 08:55:31.759111 run osmo-hlr_10.42.42.2(pid=28855): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28855)] 08:55:31.810216 run osmo-hlr_10.42.42.2(pid=28855): stdout: | (launched: 2022-12-13_08:55:28.420252) 08:55:31.862635 run osmo-hlr_10.42.42.2(pid=28855): stderr: | 20221213085528617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085528617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085528617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085528617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085528617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085528617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085528630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085528638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085528638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085528638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:31.915319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28850): Terminating (SIGTERM) 08:55:31.958352 run iperf3-srv_10.42.42.10(pid=28851): Terminating (SIGTERM) 08:55:32.003540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28854): Terminating (SIGTERM) 08:55:32.046404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28857): Terminating (SIGTERM) 08:55:32.088910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28860): Terminating (SIGTERM) 08:55:32.133105 --- ParallelTerminationStrategy: PID 28850 died... 08:55:32.153466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28850): Terminated: ok {rc=0} 08:55:32.200234 --- ParallelTerminationStrategy: PID 28851 died... 08:55:32.220241 run iperf3-srv_10.42.42.10(pid=28851): Terminated {rc=256} 08:55:32.266841 --- ParallelTerminationStrategy: PID 28854 died... 08:55:32.287084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28854): Terminated: ok {rc=0} 08:55:32.332707 --- ParallelTerminationStrategy: PID 28857 died... 08:55:32.352118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28857): Terminated: ok {rc=0} 08:55:32.397851 --- ParallelTerminationStrategy: PID 28860 died... 08:55:32.417412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28860): Terminated: ok {rc=0} 08:55:32.504134 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 08:55:33.651414 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:33.662953 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:55:33.711222 tst iperf3m4.py: using LAC 32852 08:55:33.834754 tst iperf3m4.py: using RAC 212 08:55:33.958912 tst iperf3m4.py: using CellId 32852 08:55:34.081485 tst iperf3m4.py: using BVCI 32853 08:55:34.196294 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.207464 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.218387 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.229177 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.239832 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.250528 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.261934 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.272729 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:34.284053 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:34.400534 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:34.523689 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:34.642760 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:34.758456 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:55:34.959144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:35.257378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28862): Launched 08:55:35.516080 run iperf3-srv_10.42.42.10(pid=28863): Launched 08:55:35.628438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:55:35.827384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:36.125172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28864): Launched 08:55:36.383118 run iperf3-srv_10.42.42.10(pid=28865): Launched 08:55:36.494893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:55:36.694466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:36.992102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28866): Launched 08:55:37.249745 run iperf3-srv_10.42.42.10(pid=28867): Launched 08:55:37.361257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:55:37.560600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:37.858127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28868): Launched 08:55:38.115159 run iperf3-srv_10.42.42.10(pid=28869): Launched 08:55:38.226805 tst iperf3m4.py:8: start network... 08:55:38.426030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:38.885379 run create_hlr_db(pid=28870): Launched 08:55:39.017921 bus /gobi_6: Setting Powered False 08:55:40.080905 run create_hlr_db(pid=28870): Terminated: ok {rc=0} 08:55:40.504521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28872): Launched 08:55:40.801138 run osmo-hlr_10.42.42.2(pid=28873): Launched 08:55:40.914684 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:41.427538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28875): Launched 08:55:41.723735 run osmo-stp_10.42.42.5(pid=28876): Launched 08:55:41.836219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:42.423762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28878): Launched 08:55:42.545352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:42.813793 run patchelf(pid=28879): Launched 08:55:42.990187 run osmo-stp_10.42.42.5(pid=28876): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28876)] 08:55:43.125251 run osmo-stp_10.42.42.5(pid=28876): stdout: | (launched: 2022-12-13_08:55:41.669502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:43.261494 run osmo-stp_10.42.42.5(pid=28876): stderr: | 20221213085541838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085541838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085541838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085541839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085541841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085541841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085541841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:43.397572 run osmo-stp_10.42.42.5(pid=28876): stdout: | (launched: 2022-12-13_08:55:41.669502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:43.528356 run osmo-stp_10.42.42.5(pid=28876): stderr: | 20221213085541838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085541838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085541838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085541839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085541841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085541841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085541841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:43.683502 run patchelf(pid=28879): Terminating (SIGINT) 08:55:43.862124 run patchelf(pid=28879): Terminated: ok {rc=0} 08:55:43.990438 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28876): Process ended prematurely: osmo-stp_10.42.42.5(pid=28876) [trial-2387↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28876)] [trial-2387↪gprs:trx-b200↪iperf3m4.py:8] 08:55:44.000483 tst iperf3m4.py:8: Test FAILED (10.4 sec) 08:55:44.028885 run osmo-hlr_10.42.42.2(pid=28873): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28873)] 08:55:44.078552 run osmo-hlr_10.42.42.2(pid=28873): stdout: | (launched: 2022-12-13_08:55:40.747287) 08:55:44.129879 run osmo-hlr_10.42.42.2(pid=28873): stderr: | 20221213085540921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085540921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085540921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085540921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085540921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085540921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085540933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085540942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085540942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085540942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:44.181498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28862): Terminating (SIGTERM) 08:55:44.222946 run iperf3-srv_10.42.42.10(pid=28863): Terminating (SIGTERM) 08:55:44.264314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28864): Terminating (SIGTERM) 08:55:44.306527 run iperf3-srv_10.42.42.10(pid=28865): Terminating (SIGTERM) 08:55:44.348180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28866): Terminating (SIGTERM) 08:55:44.389776 run iperf3-srv_10.42.42.10(pid=28867): Terminating (SIGTERM) 08:55:44.431260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28868): Terminating (SIGTERM) 08:55:44.472785 run iperf3-srv_10.42.42.10(pid=28869): Terminating (SIGTERM) 08:55:44.514288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28872): Terminating (SIGTERM) 08:55:44.555732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28875): Terminating (SIGTERM) 08:55:44.597140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28878): Terminating (SIGTERM) 08:55:44.638997 --- ParallelTerminationStrategy: PID 28862 died... 08:55:44.658830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28862): Terminated: ok {rc=0} 08:55:44.704732 --- ParallelTerminationStrategy: PID 28863 died... 08:55:44.724087 run iperf3-srv_10.42.42.10(pid=28863): Terminated {rc=256} 08:55:44.770199 --- ParallelTerminationStrategy: PID 28864 died... 08:55:44.789584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28864): Terminated: ok {rc=0} 08:55:44.835445 --- ParallelTerminationStrategy: PID 28865 died... 08:55:44.854861 run iperf3-srv_10.42.42.10(pid=28865): Terminated {rc=256} 08:55:44.900329 --- ParallelTerminationStrategy: PID 28866 died... 08:55:44.919650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28866): Terminated: ok {rc=0} 08:55:44.965162 --- ParallelTerminationStrategy: PID 28867 died... 08:55:44.984259 run iperf3-srv_10.42.42.10(pid=28867): Terminated {rc=256} 08:55:45.029777 --- ParallelTerminationStrategy: PID 28868 died... 08:55:45.049392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28868): Terminated: ok {rc=0} 08:55:45.095016 --- ParallelTerminationStrategy: PID 28869 died... 08:55:45.114327 run iperf3-srv_10.42.42.10(pid=28869): Terminated {rc=256} 08:55:45.159862 --- ParallelTerminationStrategy: PID 28872 died... 08:55:45.179239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28872): Terminated: ok {rc=0} 08:55:45.224437 --- ParallelTerminationStrategy: PID 28875 died... 08:55:45.243880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28875): Terminated: ok {rc=0} 08:55:45.289330 --- ParallelTerminationStrategy: PID 28878 died... 08:55:45.308660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28878): Terminated: ok {rc=0} 08:55:45.395464 bus /gobi_4: Setting Powered False 08:55:46.490671 bus /gobi_4: Setting Powered False 08:55:47.604727 bus /gobi_1: Setting Powered False 08:55:48.703301 bus /gobi_1: Setting Powered False 08:55:49.818201 bus /gobi_0: Setting Powered False 08:55:50.916778 bus /gobi_0: Setting Powered False 08:55:52.031256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200 ping.py ---------------------------------------------- 08:55:53.133867 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.145449 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:55:53.195049 tst ping.py: using LAC 32853 08:55:53.320517 tst ping.py: using RAC 213 08:55:53.445092 tst ping.py: using CellId 32853 08:55:53.568233 tst ping.py: using BVCI 32854 08:55:53.684045 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.695056 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.705940 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.716666 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.727991 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.739390 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.750814 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:55:53.762610 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:55:53.877573 tst ping.py:19: start network... 08:55:54.074472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:54.525670 run create_hlr_db(pid=28883): Launched 08:55:54.636672 bus /gobi_6: Setting Powered False 08:55:55.695224 run create_hlr_db(pid=28883): Terminated: ok {rc=0} 08:55:56.121684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28885): Launched 08:55:56.432429 run osmo-hlr_10.42.42.2(pid=28886): Launched 08:55:56.551433 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:57.092522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28888): Launched 08:55:57.404699 run osmo-stp_10.42.42.5(pid=28889): Launched 08:55:57.525066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:58.064303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28891): Launched 08:55:58.183219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:58.445244 run patchelf(pid=28892): Launched 08:55:58.617876 run osmo-stp_10.42.42.5(pid=28889): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28889)] 08:55:58.749669 run osmo-stp_10.42.42.5(pid=28889): stdout: | (launched: 2022-12-13_08:55:57.348241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:58.883567 run osmo-stp_10.42.42.5(pid=28889): stderr: | 20221213085557541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085557541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085557541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085557542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085557542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085557542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085557542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:59.017152 run osmo-stp_10.42.42.5(pid=28889): stdout: | (launched: 2022-12-13_08:55:57.348241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:59.146016 run osmo-stp_10.42.42.5(pid=28889): stderr: | 20221213085557541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085557541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085557541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085557542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085557542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085557542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085557542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:59.298070 run patchelf(pid=28892): Terminating (SIGINT) 08:55:59.472773 run patchelf(pid=28892): Terminated: ok {rc=0} 08:55:59.598697 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28889): Process ended prematurely: osmo-stp_10.42.42.5(pid=28889) [trial-2387↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28889)] [trial-2387↪gprs:trx-b200↪ping.py:22] 08:55:59.607973 tst ping.py:22: Test FAILED (6.5 sec) 08:55:59.635738 run osmo-hlr_10.42.42.2(pid=28886): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28886)] 08:55:59.685317 run osmo-hlr_10.42.42.2(pid=28886): stdout: | (launched: 2022-12-13_08:55:56.375955) 08:55:59.736482 run osmo-hlr_10.42.42.2(pid=28886): stderr: | 20221213085556575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085556575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085556575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085556575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085556575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085556575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085556587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085556597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085556597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085556597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:59.787971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28885): Terminating (SIGTERM) 08:55:59.829807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28888): Terminating (SIGTERM) 08:55:59.871271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28891): Terminating (SIGTERM) 08:55:59.912613 --- ParallelTerminationStrategy: PID 28885 died... 08:55:59.932427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28885): Terminated: ok {rc=0} 08:55:59.978155 --- ParallelTerminationStrategy: PID 28888 died... 08:55:59.997584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28888): Terminated: ok {rc=0} 08:56:00.043184 --- ParallelTerminationStrategy: PID 28891 died... 08:56:00.062566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28891): Terminated: ok {rc=0} 08:56:00.150081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 08:56:01.239478 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.255138 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:56:01.316757 tst ping_idle_ping.py: using LAC 32854 08:56:01.480878 tst ping_idle_ping.py: using RAC 214 08:56:01.606412 tst ping_idle_ping.py: using CellId 32854 08:56:01.761322 tst ping_idle_ping.py: using BVCI 32855 08:56:01.894125 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.909481 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.924199 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.936617 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.950850 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.965717 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.979908 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:56:01.994993 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:56:02.143404 tst ping_idle_ping.py:24: start network... 08:56:02.378665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:02.838070 run create_hlr_db(pid=28893): Launched 08:56:02.950197 bus /gobi_6: Setting Powered False 08:56:04.008891 run create_hlr_db(pid=28893): Terminated: ok {rc=0} 08:56:04.437700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Launched 08:56:04.748905 run osmo-hlr_10.42.42.2(pid=28896): Launched 08:56:04.869052 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:05.377122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Launched 08:56:05.669071 run osmo-stp_10.42.42.5(pid=28899): Launched 08:56:05.780581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:06.283948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Launched 08:56:06.395904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:06.642161 run patchelf(pid=28902): Launched 08:56:06.804367 run osmo-stp_10.42.42.5(pid=28899): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] 08:56:06.928411 run osmo-stp_10.42.42.5(pid=28899): stdout: | (launched: 2022-12-13_08:56:05.615724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:07.054028 run osmo-stp_10.42.42.5(pid=28899): stderr: | 20221213085605784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085605784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085605785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085605785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085605785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085605785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085605786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:07.179959 run osmo-stp_10.42.42.5(pid=28899): stdout: | (launched: 2022-12-13_08:56:05.615724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:07.301157 run osmo-stp_10.42.42.5(pid=28899): stderr: | 20221213085605784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085605784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085605785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085605785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085605785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085605785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085605786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:07.443591 run patchelf(pid=28902): Terminating (SIGINT) 08:56:07.607753 run patchelf(pid=28902): Terminated: ok {rc=0} 08:56:07.726141 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28899): Process ended prematurely: osmo-stp_10.42.42.5(pid=28899) [trial-2387↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] [trial-2387↪gprs:trx-b200↪ping_idle_ping.py:27] 08:56:07.734968 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:56:07.761118 run osmo-hlr_10.42.42.2(pid=28896): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28896)] 08:56:07.808868 run osmo-hlr_10.42.42.2(pid=28896): stdout: | (launched: 2022-12-13_08:56:04.692771) 08:56:07.857948 run osmo-hlr_10.42.42.2(pid=28896): stderr: | 20221213085604890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085604890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085604890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085604890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085604890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085604890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085604914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085604924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085604924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085604924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:07.907354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Terminating (SIGTERM) 08:56:07.946845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Terminating (SIGTERM) 08:56:07.986612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Terminating (SIGTERM) 08:56:08.026592 --- ParallelTerminationStrategy: PID 28895 died... 08:56:08.046138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Terminated: ok {rc=0} 08:56:08.090005 --- ParallelTerminationStrategy: PID 28898 died... 08:56:08.108940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Terminated: ok {rc=0} 08:56:08.152744 --- ParallelTerminationStrategy: PID 28901 died... 08:56:08.171573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Terminated: ok {rc=0} 08:56:08.254056 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 08:56:09.556115 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:09.561424 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:56:09.593820 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:56:09.633754 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:56:09.721696 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:56:09.754418 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:56:09.792746 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:56:10.383221 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:56:10.432244 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:10.443173 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:56:10.493701 tst cs_paging_gprs_active.py: using LAC 32855 08:56:10.620767 tst cs_paging_gprs_active.py: using RAC 215 08:56:10.745480 tst cs_paging_gprs_active.py: using CellId 32855 08:56:10.872407 tst cs_paging_gprs_active.py: using BVCI 32856 08:56:10.989484 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.000597 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.011579 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.022567 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.033571 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.044471 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.055643 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.066573 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:11.077932 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:11.195727 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:11.313958 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:56:11.514137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:11.812941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28906): Launched 08:56:12.071911 run iperf3-srv_10.42.42.10(pid=28907): Launched 08:56:12.183637 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:56:12.382679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:12.681338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28908): Launched 08:56:12.939763 run iperf3-srv_10.42.42.10(pid=28909): Launched 08:56:13.051653 tst cs_paging_gprs_active.py:38: start network... 08:56:13.250881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:13.711910 run create_hlr_db(pid=28910): Launched 08:56:13.826419 bus /gobi_6: Setting Powered False 08:56:14.885893 run create_hlr_db(pid=28910): Terminated: ok {rc=0} 08:56:15.320697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28912): Launched 08:56:15.637991 run osmo-hlr_10.42.42.2(pid=28913): Launched 08:56:15.759804 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:16.324904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28915): Launched 08:56:16.659586 run osmo-stp_10.42.42.5(pid=28916): Launched 08:56:16.875631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:17.515865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28918): Launched 08:56:17.636830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:17.905338 run patchelf(pid=28919): Launched 08:56:18.081692 run osmo-stp_10.42.42.5(pid=28916): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28916)] 08:56:18.216489 run osmo-stp_10.42.42.5(pid=28916): stdout: | (launched: 2022-12-13_08:56:16.593251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:18.353236 run osmo-stp_10.42.42.5(pid=28916): stderr: | 20221213085616960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085616960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085616960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085616966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085616967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085616967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085616967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:18.489599 run osmo-stp_10.42.42.5(pid=28916): stdout: | (launched: 2022-12-13_08:56:16.593251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:18.620058 run osmo-stp_10.42.42.5(pid=28916): stderr: | 20221213085616960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085616960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085616960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085616966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085616967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085616967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085616967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:18.775197 run patchelf(pid=28919): Terminating (SIGINT) 08:56:18.955188 run patchelf(pid=28919): Terminated: ok {rc=0} 08:56:19.084371 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28916): Process ended prematurely: osmo-stp_10.42.42.5(pid=28916) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28916)] [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:56:19.094585 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:56:19.122721 run osmo-hlr_10.42.42.2(pid=28913): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28913)] 08:56:19.172187 run osmo-hlr_10.42.42.2(pid=28913): stdout: | (launched: 2022-12-13_08:56:15.581091) 08:56:19.223615 run osmo-hlr_10.42.42.2(pid=28913): stderr: | 20221213085615780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085615780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085615780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085615780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085615780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085615780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085615793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085615802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085615803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085615803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:19.275213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28906): Terminating (SIGTERM) 08:56:19.316595 run iperf3-srv_10.42.42.10(pid=28907): Terminating (SIGTERM) 08:56:19.358217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28908): Terminating (SIGTERM) 08:56:19.399532 run iperf3-srv_10.42.42.10(pid=28909): Terminating (SIGTERM) 08:56:19.440544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28912): Terminating (SIGTERM) 08:56:19.481948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28915): Terminating (SIGTERM) 08:56:19.523473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28918): Terminating (SIGTERM) 08:56:19.565023 --- ParallelTerminationStrategy: PID 28906 died... 08:56:19.584762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28906): Terminated: ok {rc=0} 08:56:19.630235 --- ParallelTerminationStrategy: PID 28907 died... 08:56:19.649285 run iperf3-srv_10.42.42.10(pid=28907): Terminated {rc=256} 08:56:19.694444 --- ParallelTerminationStrategy: PID 28908 died... 08:56:19.713764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28908): Terminated: ok {rc=0} 08:56:19.759175 --- ParallelTerminationStrategy: PID 28909 died... 08:56:19.778295 run iperf3-srv_10.42.42.10(pid=28909): Terminated {rc=256} 08:56:19.823860 --- ParallelTerminationStrategy: PID 28912 died... 08:56:19.842998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28912): Terminated: ok {rc=0} 08:56:19.888907 --- ParallelTerminationStrategy: PID 28915 died... 08:56:19.908350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28915): Terminated: ok {rc=0} 08:56:19.954090 --- ParallelTerminationStrategy: PID 28918 died... 08:56:19.973516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28918): Terminated: ok {rc=0} 08:56:20.060492 bus /gobi_0: Setting Powered False 08:56:21.159730 bus /gobi_0: Setting Powered False 08:56:22.275544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:56:23.423811 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:23.435697 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:56:23.489479 tst iperf3.py: using LAC 32856 08:56:23.620896 tst iperf3.py: using RAC 216 08:56:23.744919 tst iperf3.py: using CellId 32856 08:56:23.867930 tst iperf3.py: using BVCI 32857 08:56:23.983361 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:23.994736 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:24.005756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:24.016729 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:24.027728 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:24.038658 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:24.049813 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:24.060639 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:24.072291 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:24.192112 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:56:24.407149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:24.725373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28920): Launched 08:56:25.001866 run iperf3-srv_10.42.42.10(pid=28921): Launched 08:56:25.121293 tst iperf3.py:8: start network... 08:56:25.335613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:25.827798 run create_hlr_db(pid=28922): Launched 08:56:25.956625 bus /gobi_6: Setting Powered False 08:56:27.019688 run create_hlr_db(pid=28922): Terminated: ok {rc=0} 08:56:27.443122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28924): Launched 08:56:27.739030 run osmo-hlr_10.42.42.2(pid=28925): Launched 08:56:27.852246 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:28.377239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28927): Launched 08:56:28.672432 run osmo-stp_10.42.42.5(pid=28928): Launched 08:56:28.786346 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:29.295332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28930): Launched 08:56:29.408480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:29.657162 run patchelf(pid=28931): Launched 08:56:29.821589 run osmo-stp_10.42.42.5(pid=28928): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28928)] 08:56:29.947193 run osmo-stp_10.42.42.5(pid=28928): stdout: | (launched: 2022-12-13_08:56:28.618888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:30.074876 run osmo-stp_10.42.42.5(pid=28928): stderr: | 20221213085628788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085628788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085628788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085628788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085628789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085628789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085628789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:30.202796 run osmo-stp_10.42.42.5(pid=28928): stdout: | (launched: 2022-12-13_08:56:28.618888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:30.324346 run osmo-stp_10.42.42.5(pid=28928): stderr: | 20221213085628788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085628788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085628788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085628788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085628789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085628789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085628789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:30.468613 run patchelf(pid=28931): Terminating (SIGINT) 08:56:30.635040 run patchelf(pid=28931): Terminated: ok {rc=0} 08:56:30.755393 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28928): Process ended prematurely: osmo-stp_10.42.42.5(pid=28928) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28928)] [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 08:56:30.764727 tst iperf3.py:8: Test FAILED (7.4 sec) 08:56:30.791471 run osmo-hlr_10.42.42.2(pid=28925): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28925)] 08:56:30.839207 run osmo-hlr_10.42.42.2(pid=28925): stdout: | (launched: 2022-12-13_08:56:27.685597) 08:56:30.888507 run osmo-hlr_10.42.42.2(pid=28925): stderr: | 20221213085627860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085627860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085627860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085627860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085627860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085627860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085627872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085627881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085627881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085627881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:30.963570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28920): Terminating (SIGTERM) 08:56:31.026212 run iperf3-srv_10.42.42.10(pid=28921): Terminating (SIGTERM) 08:56:31.069189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28924): Terminating (SIGTERM) 08:56:31.113828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28927): Terminating (SIGTERM) 08:56:31.161231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28930): Terminating (SIGTERM) 08:56:31.207264 --- ParallelTerminationStrategy: PID 28920 died... 08:56:31.229378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28920): Terminated: ok {rc=0} 08:56:31.279643 --- ParallelTerminationStrategy: PID 28921 died... 08:56:31.301303 run iperf3-srv_10.42.42.10(pid=28921): Terminated {rc=256} 08:56:31.350650 --- ParallelTerminationStrategy: PID 28924 died... 08:56:31.373158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28924): Terminated: ok {rc=0} 08:56:31.422437 --- ParallelTerminationStrategy: PID 28927 died... 08:56:31.443889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28927): Terminated: ok {rc=0} 08:56:31.494173 --- ParallelTerminationStrategy: PID 28930 died... 08:56:31.516144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28930): Terminated: ok {rc=0} 08:56:31.609689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:56:32.758768 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:32.770739 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:56:32.821996 tst iperf3m4.py: using LAC 32857 08:56:32.941614 tst iperf3m4.py: using RAC 217 08:56:33.069287 tst iperf3m4.py: using CellId 32857 08:56:33.194308 tst iperf3m4.py: using BVCI 32858 08:56:33.311837 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.323408 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.334700 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.346012 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.357465 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.368852 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.380519 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.391925 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:33.403435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:33.523544 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:33.642764 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:33.762670 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:33.879576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:56:34.095299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:34.413327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28932): Launched 08:56:34.688229 run iperf3-srv_10.42.42.10(pid=28933): Launched 08:56:34.807356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:56:35.024054 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:35.342439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28934): Launched 08:56:35.618789 run iperf3-srv_10.42.42.10(pid=28935): Launched 08:56:35.737960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:56:35.952609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:36.271211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28936): Launched 08:56:36.547496 run iperf3-srv_10.42.42.10(pid=28937): Launched 08:56:36.666980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:56:36.881520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:37.199940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28938): Launched 08:56:37.475908 run iperf3-srv_10.42.42.10(pid=28939): Launched 08:56:37.595955 tst iperf3m4.py:8: start network... 08:56:37.810100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:38.306336 run create_hlr_db(pid=28940): Launched 08:56:38.435954 bus /gobi_6: Setting Powered False 08:56:39.499813 run create_hlr_db(pid=28940): Terminated: ok {rc=0} 08:56:39.942519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28942): Launched 08:56:40.261894 run osmo-hlr_10.42.42.2(pid=28943): Launched 08:56:40.382235 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:40.934388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28945): Launched 08:56:41.251998 run osmo-stp_10.42.42.5(pid=28946): Launched 08:56:41.373978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:41.924831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28948): Launched 08:56:42.046725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:42.315446 run patchelf(pid=28949): Launched 08:56:42.492125 run osmo-stp_10.42.42.5(pid=28946): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28946)] 08:56:42.627046 run osmo-stp_10.42.42.5(pid=28946): stdout: | (launched: 2022-12-13_08:56:41.194300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:42.763717 run osmo-stp_10.42.42.5(pid=28946): stderr: | 20221213085641386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085641386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085641386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085641387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085641387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085641387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085641387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:42.900524 run osmo-stp_10.42.42.5(pid=28946): stdout: | (launched: 2022-12-13_08:56:41.194300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:43.031317 run osmo-stp_10.42.42.5(pid=28946): stderr: | 20221213085641386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085641386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085641386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085641387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085641387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085641387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085641387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:43.187035 run patchelf(pid=28949): Terminating (SIGINT) 08:56:43.365472 run patchelf(pid=28949): Terminated: ok {rc=0} 08:56:43.494177 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28946): Process ended prematurely: osmo-stp_10.42.42.5(pid=28946) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28946)] [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 08:56:43.504619 tst iperf3m4.py:8: Test FAILED (10.8 sec) 08:56:43.533725 run osmo-hlr_10.42.42.2(pid=28943): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28943)] 08:56:43.583566 run osmo-hlr_10.42.42.2(pid=28943): stdout: | (launched: 2022-12-13_08:56:40.204454) 08:56:43.634792 run osmo-hlr_10.42.42.2(pid=28943): stderr: | 20221213085640403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085640403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085640403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085640403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085640403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085640403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085640416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085640424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085640424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085640424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:43.686593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28932): Terminating (SIGTERM) 08:56:43.728260 run iperf3-srv_10.42.42.10(pid=28933): Terminating (SIGTERM) 08:56:43.770218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28934): Terminating (SIGTERM) 08:56:43.812042 run iperf3-srv_10.42.42.10(pid=28935): Terminating (SIGTERM) 08:56:43.853888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28936): Terminating (SIGTERM) 08:56:43.895764 run iperf3-srv_10.42.42.10(pid=28937): Terminating (SIGTERM) 08:56:43.937339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28938): Terminating (SIGTERM) 08:56:43.978950 run iperf3-srv_10.42.42.10(pid=28939): Terminating (SIGTERM) 08:56:44.020685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28942): Terminating (SIGTERM) 08:56:44.062195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28945): Terminating (SIGTERM) 08:56:44.103766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28948): Terminating (SIGTERM) 08:56:44.145596 --- ParallelTerminationStrategy: PID 28932 died... 08:56:44.165622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28932): Terminated: ok {rc=0} 08:56:44.211468 --- ParallelTerminationStrategy: PID 28933 died... 08:56:44.231070 run iperf3-srv_10.42.42.10(pid=28933): Terminated {rc=256} 08:56:44.277176 --- ParallelTerminationStrategy: PID 28934 died... 08:56:44.296583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28934): Terminated: ok {rc=0} 08:56:44.342359 --- ParallelTerminationStrategy: PID 28935 died... 08:56:44.361904 run iperf3-srv_10.42.42.10(pid=28935): Terminated {rc=256} 08:56:44.407463 --- ParallelTerminationStrategy: PID 28936 died... 08:56:44.426915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28936): Terminated: ok {rc=0} 08:56:44.472583 --- ParallelTerminationStrategy: PID 28937 died... 08:56:44.492013 run iperf3-srv_10.42.42.10(pid=28937): Terminated {rc=256} 08:56:44.538054 --- ParallelTerminationStrategy: PID 28938 died... 08:56:44.557644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28938): Terminated: ok {rc=0} 08:56:44.603302 --- ParallelTerminationStrategy: PID 28939 died... 08:56:44.622909 run iperf3-srv_10.42.42.10(pid=28939): Terminated {rc=256} 08:56:44.668542 --- ParallelTerminationStrategy: PID 28942 died... 08:56:44.688128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28942): Terminated: ok {rc=0} 08:56:44.733595 --- ParallelTerminationStrategy: PID 28945 died... 08:56:44.753207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28945): Terminated: ok {rc=0} 08:56:44.798841 --- ParallelTerminationStrategy: PID 28948 died... 08:56:44.818193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28948): Terminated: ok {rc=0} 08:56:44.905327 bus /gobi_4: Setting Powered False 08:56:46.017106 bus /gobi_4: Setting Powered False 08:56:47.136378 bus /gobi_1: Setting Powered False 08:56:48.234213 bus /gobi_1: Setting Powered False 08:56:49.347963 bus /gobi_0: Setting Powered False 08:56:50.446584 bus /gobi_0: Setting Powered False 08:56:51.559730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 08:56:52.659177 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:52.670422 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:56:52.738568 tst ping.py: using LAC 32858 08:56:52.864094 tst ping.py: using RAC 218 08:56:52.989654 tst ping.py: using CellId 32858 08:56:53.112608 tst ping.py: using BVCI 32859 08:56:53.228073 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:53.239617 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:53.250770 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:53.261958 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:53.272892 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:53.283871 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:53.295152 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:53.306236 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:53.422371 tst ping.py:19: start network... 08:56:53.632144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:54.114943 run create_hlr_db(pid=28950): Launched 08:56:54.242256 bus /gobi_6: Setting Powered False 08:56:55.304401 run create_hlr_db(pid=28950): Terminated: ok {rc=0} 08:56:55.722537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28952): Launched 08:56:56.013641 run osmo-hlr_10.42.42.2(pid=28953): Launched 08:56:56.124511 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:56.643034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28955): Launched 08:56:56.933389 run osmo-stp_10.42.42.5(pid=28956): Launched 08:56:57.044148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:57.546631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28958): Launched 08:56:57.658162 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:57.903864 run patchelf(pid=28959): Launched 08:56:58.066002 run osmo-stp_10.42.42.5(pid=28956): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28956)] 08:56:58.189625 run osmo-stp_10.42.42.5(pid=28956): stdout: | (launched: 2022-12-13_08:56:56.880468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:58.315079 run osmo-stp_10.42.42.5(pid=28956): stderr: | 20221213085657048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085657048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085657049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085657049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085657051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085657051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085657051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:58.440331 run osmo-stp_10.42.42.5(pid=28956): stdout: | (launched: 2022-12-13_08:56:56.880468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:58.560248 run osmo-stp_10.42.42.5(pid=28956): stderr: | 20221213085657048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085657048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085657049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085657049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085657051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085657051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085657051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:58.702359 run patchelf(pid=28959): Terminating (SIGINT) 08:56:58.865749 run patchelf(pid=28959): Terminated: ok {rc=0} 08:56:58.983414 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28956): Process ended prematurely: osmo-stp_10.42.42.5(pid=28956) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28956)] [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 08:56:58.992207 tst ping.py:22: Test FAILED (6.3 sec) 08:56:59.018547 run osmo-hlr_10.42.42.2(pid=28953): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28953)] 08:56:59.066945 run osmo-hlr_10.42.42.2(pid=28953): stdout: | (launched: 2022-12-13_08:56:55.960738) 08:56:59.117253 run osmo-hlr_10.42.42.2(pid=28953): stderr: | 20221213085656133 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085656133 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085656133 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085656133 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085656133 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085656134 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085656147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085656158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085656158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085656159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:59.166988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28952): Terminating (SIGTERM) 08:56:59.206833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28955): Terminating (SIGTERM) 08:56:59.246795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28958): Terminating (SIGTERM) 08:56:59.287028 --- ParallelTerminationStrategy: PID 28952 died... 08:56:59.306583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28952): Terminated: ok {rc=0} 08:56:59.351188 --- ParallelTerminationStrategy: PID 28955 died... 08:56:59.370547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28955): Terminated: ok {rc=0} 08:56:59.414673 --- ParallelTerminationStrategy: PID 28958 died... 08:56:59.433774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28958): Terminated: ok {rc=0} 08:56:59.519763 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:57:00.606632 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:00.618114 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:57:00.670687 tst ping_idle_ping.py: using LAC 32859 08:57:00.794550 tst ping_idle_ping.py: using RAC 219 08:57:00.921477 tst ping_idle_ping.py: using CellId 32859 08:57:01.077230 tst ping_idle_ping.py: using BVCI 32860 08:57:01.230006 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:01.243523 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:01.258171 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:01.274269 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:01.291064 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:01.306845 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:01.320844 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:01.332659 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:57:01.465515 tst ping_idle_ping.py:24: start network... 08:57:01.724433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:02.230210 run create_hlr_db(pid=28960): Launched 08:57:02.390118 bus /gobi_6: Setting Powered False 08:57:03.452390 run create_hlr_db(pid=28960): Terminated: ok {rc=0} 08:57:03.872076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28962): Launched 08:57:04.165492 run osmo-hlr_10.42.42.2(pid=28963): Launched 08:57:04.277278 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:04.795699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28965): Launched 08:57:05.088635 run osmo-stp_10.42.42.5(pid=28966): Launched 08:57:05.200806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:05.707836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28968): Launched 08:57:05.820601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:06.068195 run patchelf(pid=28969): Launched 08:57:06.231526 run osmo-stp_10.42.42.5(pid=28966): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28966)] 08:57:06.356358 run osmo-stp_10.42.42.5(pid=28966): stdout: | (launched: 2022-12-13_08:57:05.035133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:06.482398 run osmo-stp_10.42.42.5(pid=28966): stderr: | 20221213085705206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085705207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085705207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085705207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085705208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085705208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085705208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:06.608669 run osmo-stp_10.42.42.5(pid=28966): stdout: | (launched: 2022-12-13_08:57:05.035133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:06.729427 run osmo-stp_10.42.42.5(pid=28966): stderr: | 20221213085705206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085705207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085705207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085705207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085705208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085705208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085705208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:06.872742 run patchelf(pid=28969): Terminating (SIGINT) 08:57:07.037535 run patchelf(pid=28969): Terminated: ok {rc=0} 08:57:07.156424 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28966): Process ended prematurely: osmo-stp_10.42.42.5(pid=28966) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28966)] [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 08:57:07.165287 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:57:07.191904 run osmo-hlr_10.42.42.2(pid=28963): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28963)] 08:57:07.240617 run osmo-hlr_10.42.42.2(pid=28963): stdout: | (launched: 2022-12-13_08:57:04.111929) 08:57:07.290391 run osmo-hlr_10.42.42.2(pid=28963): stderr: | 20221213085704285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085704285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085704285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085704285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085704285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085704285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085704297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085704306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085704306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085704306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:07.340471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28962): Terminating (SIGTERM) 08:57:07.380480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28965): Terminating (SIGTERM) 08:57:07.420506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28968): Terminating (SIGTERM) 08:57:07.460727 --- ParallelTerminationStrategy: PID 28962 died... 08:57:07.480484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28962): Terminated: ok {rc=0} 08:57:07.524681 --- ParallelTerminationStrategy: PID 28965 died... 08:57:07.543774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28965): Terminated: ok {rc=0} 08:57:07.587918 --- ParallelTerminationStrategy: PID 28968 died... 08:57:07.606841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28968): Terminated: ok {rc=0} 08:57:07.692616 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:57:08.999603 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:57:09.007196 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:57:09.041439 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:57:09.081305 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:57:09.170090 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:57:09.203468 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:57:09.242665 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:57:09.840035 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:57:09.891864 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:09.903288 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:57:09.977210 tst cs_paging_gprs_active.py: using LAC 32860 08:57:10.103244 tst cs_paging_gprs_active.py: using RAC 220 08:57:10.228930 tst cs_paging_gprs_active.py: using CellId 32860 08:57:10.357446 tst cs_paging_gprs_active.py: using BVCI 32861 08:57:10.474685 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.485996 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.496924 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.507976 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.519206 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.530612 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.542028 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.553255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:10.564618 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:10.680575 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:10.800624 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:57:11.016411 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:11.334684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28974): Launched 08:57:11.611033 run iperf3-srv_10.42.42.10(pid=28975): Launched 08:57:11.730806 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:57:11.946803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:12.265546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Launched 08:57:12.541377 run iperf3-srv_10.42.42.10(pid=28977): Launched 08:57:12.660270 tst cs_paging_gprs_active.py:38: start network... 08:57:12.875195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:13.367311 run create_hlr_db(pid=28978): Launched 08:57:13.495804 bus /gobi_6: Setting Powered False 08:57:14.559698 run create_hlr_db(pid=28978): Terminated: ok {rc=0} 08:57:15.002154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28980): Launched 08:57:15.319105 run osmo-hlr_10.42.42.2(pid=28981): Launched 08:57:15.439975 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:15.991335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28983): Launched 08:57:16.350406 run osmo-stp_10.42.42.5(pid=28984): Launched 08:57:16.599095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:17.240426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28986): Launched 08:57:17.368010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:17.638383 run patchelf(pid=28987): Launched 08:57:17.816085 run osmo-stp_10.42.42.5(pid=28984): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28984)] 08:57:17.951421 run osmo-stp_10.42.42.5(pid=28984): stdout: | (launched: 2022-12-13_08:57:16.283181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:18.088274 run osmo-stp_10.42.42.5(pid=28984): stderr: | 20221213085716572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085716573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085716575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085716576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085716577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085716578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085716578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:18.224626 run osmo-stp_10.42.42.5(pid=28984): stdout: | (launched: 2022-12-13_08:57:16.283181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:18.355391 run osmo-stp_10.42.42.5(pid=28984): stderr: | 20221213085716572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085716573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085716575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085716576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085716577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085716578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085716578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:18.510297 run patchelf(pid=28987): Terminating (SIGINT) 08:57:18.688477 run patchelf(pid=28987): Terminated: ok {rc=0} 08:57:18.816785 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28984): Process ended prematurely: osmo-stp_10.42.42.5(pid=28984) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28984)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:57:18.827120 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:57:18.855533 run osmo-hlr_10.42.42.2(pid=28981): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28981)] 08:57:18.905713 run osmo-hlr_10.42.42.2(pid=28981): stdout: | (launched: 2022-12-13_08:57:15.261910) 08:57:18.957488 run osmo-hlr_10.42.42.2(pid=28981): stderr: | 20221213085715461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085715461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085715461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085715461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085715461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085715461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085715474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085715482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085715482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085715482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:19.009660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28974): Terminating (SIGTERM) 08:57:19.051639 run iperf3-srv_10.42.42.10(pid=28975): Terminating (SIGTERM) 08:57:19.093474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Terminating (SIGTERM) 08:57:19.135462 run iperf3-srv_10.42.42.10(pid=28977): Terminating (SIGTERM) 08:57:19.177219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28980): Terminating (SIGTERM) 08:57:19.218947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28983): Terminating (SIGTERM) 08:57:19.260902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28986): Terminating (SIGTERM) 08:57:19.302888 --- ParallelTerminationStrategy: PID 28974 died... 08:57:19.323002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28974): Terminated: ok {rc=0} 08:57:19.369337 --- ParallelTerminationStrategy: PID 28975 died... 08:57:19.389006 run iperf3-srv_10.42.42.10(pid=28975): Terminated {rc=256} 08:57:19.434761 --- ParallelTerminationStrategy: PID 28976 died... 08:57:19.454649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Terminated: ok {rc=0} 08:57:19.500459 --- ParallelTerminationStrategy: PID 28977 died... 08:57:19.520087 run iperf3-srv_10.42.42.10(pid=28977): Terminated {rc=256} 08:57:19.565990 --- ParallelTerminationStrategy: PID 28980 died... 08:57:19.585600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28980): Terminated: ok {rc=0} 08:57:19.631067 --- ParallelTerminationStrategy: PID 28983 died... 08:57:19.650636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28983): Terminated: ok {rc=0} 08:57:19.696158 --- ParallelTerminationStrategy: PID 28986 died... 08:57:19.715843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28986): Terminated: ok {rc=0} 08:57:19.802903 bus /gobi_0: Setting Powered False 08:57:20.899915 bus /gobi_0: Setting Powered False 08:57:22.015592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:57:23.159292 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.170811 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:57:23.242553 tst iperf3.py: using LAC 32861 08:57:23.361670 tst iperf3.py: using RAC 221 08:57:23.479529 tst iperf3.py: using CellId 32861 08:57:23.597297 tst iperf3.py: using BVCI 32862 08:57:23.706578 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.717620 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.728315 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.738984 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.749759 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.761180 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.772290 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.783345 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:23.794549 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:23.911265 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:57:24.112065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:24.410547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28988): Launched 08:57:24.669435 run iperf3-srv_10.42.42.10(pid=28989): Launched 08:57:24.781766 tst iperf3.py:8: start network... 08:57:24.981908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:25.441421 run create_hlr_db(pid=28990): Launched 08:57:25.554942 bus /gobi_6: Setting Powered False 08:57:26.613906 run create_hlr_db(pid=28990): Terminated: ok {rc=0} 08:57:27.027000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28992): Launched 08:57:27.321778 run osmo-hlr_10.42.42.2(pid=28993): Launched 08:57:27.434925 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:27.960133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28995): Launched 08:57:28.257339 run osmo-stp_10.42.42.5(pid=28996): Launched 08:57:28.371177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:28.882377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28998): Launched 08:57:28.995559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:29.248002 run patchelf(pid=28999): Launched 08:57:29.413238 run osmo-stp_10.42.42.5(pid=28996): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28996)] 08:57:29.539022 run osmo-stp_10.42.42.5(pid=28996): stdout: | (launched: 2022-12-13_08:57:28.203508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:29.666445 run osmo-stp_10.42.42.5(pid=28996): stderr: | 20221213085728374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085728375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085728375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085728375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085728376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085728376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085728376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:29.793788 run osmo-stp_10.42.42.5(pid=28996): stdout: | (launched: 2022-12-13_08:57:28.203508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:29.916596 run osmo-stp_10.42.42.5(pid=28996): stderr: | 20221213085728374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085728375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085728375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085728375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085728376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085728376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085728376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:30.061138 run patchelf(pid=28999): Terminating (SIGINT) 08:57:30.228084 run patchelf(pid=28999): Terminated: ok {rc=0} 08:57:30.348625 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28996): Process ended prematurely: osmo-stp_10.42.42.5(pid=28996) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28996)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 08:57:30.358133 tst iperf3.py:8: Test FAILED (7.2 sec) 08:57:30.385017 run osmo-hlr_10.42.42.2(pid=28993): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28993)] 08:57:30.433368 run osmo-hlr_10.42.42.2(pid=28993): stdout: | (launched: 2022-12-13_08:57:27.268145) 08:57:30.483070 run osmo-hlr_10.42.42.2(pid=28993): stderr: | 20221213085727444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085727444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085727444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085727444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085727444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085727444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085727456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085727464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085727464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085727465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:30.533490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28988): Terminating (SIGTERM) 08:57:30.573550 run iperf3-srv_10.42.42.10(pid=28989): Terminating (SIGTERM) 08:57:30.613591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28992): Terminating (SIGTERM) 08:57:30.653770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28995): Terminating (SIGTERM) 08:57:30.693801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28998): Terminating (SIGTERM) 08:57:30.734063 --- ParallelTerminationStrategy: PID 28988 died... 08:57:30.753496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28988): Terminated: ok {rc=0} 08:57:30.797890 --- ParallelTerminationStrategy: PID 28989 died... 08:57:30.816748 run iperf3-srv_10.42.42.10(pid=28989): Terminated {rc=256} 08:57:30.861024 --- ParallelTerminationStrategy: PID 28992 died... 08:57:30.879920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28992): Terminated: ok {rc=0} 08:57:30.927369 --- ParallelTerminationStrategy: PID 28995 died... 08:57:30.947145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28995): Terminated: ok {rc=0} 08:57:31.001816 --- ParallelTerminationStrategy: PID 28998 died... 08:57:31.020805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28998): Terminated: ok {rc=0} 08:57:31.112196 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:57:32.282381 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.296246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:57:32.368408 tst iperf3m4.py: using LAC 32862 08:57:32.487273 tst iperf3m4.py: using RAC 222 08:57:32.606643 tst iperf3m4.py: using CellId 32862 08:57:32.723428 tst iperf3m4.py: using BVCI 32863 08:57:32.833319 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.844286 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.855161 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.866043 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.876934 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.888018 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.899263 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.910163 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:32.921126 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:33.036907 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:33.158772 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:33.275787 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:33.396434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:57:33.613859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:33.933892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29001): Launched 08:57:34.210251 run iperf3-srv_10.42.42.10(pid=29002): Launched 08:57:34.329671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:57:34.544617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:34.864123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29003): Launched 08:57:35.139821 run iperf3-srv_10.42.42.10(pid=29004): Launched 08:57:35.259422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:57:35.474696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:35.794111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29005): Launched 08:57:36.069946 run iperf3-srv_10.42.42.10(pid=29006): Launched 08:57:36.189063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:57:36.404128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:36.723126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29007): Launched 08:57:36.998993 run iperf3-srv_10.42.42.10(pid=29008): Launched 08:57:37.118130 tst iperf3m4.py:8: start network... 08:57:37.332125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:37.828034 run create_hlr_db(pid=29009): Launched 08:57:37.958072 bus /gobi_6: Setting Powered False 08:57:39.021239 run create_hlr_db(pid=29009): Terminated: ok {rc=0} 08:57:39.444664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Launched 08:57:39.742189 run osmo-hlr_10.42.42.2(pid=29012): Launched 08:57:39.855588 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:40.369077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Launched 08:57:40.666954 run osmo-stp_10.42.42.5(pid=29015): Launched 08:57:40.780213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:41.292318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29017): Launched 08:57:41.406633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:41.658363 run patchelf(pid=29018): Launched 08:57:41.824289 run osmo-stp_10.42.42.5(pid=29015): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] 08:57:41.950885 run osmo-stp_10.42.42.5(pid=29015): stdout: | (launched: 2022-12-13_08:57:40.612463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:42.079336 run osmo-stp_10.42.42.5(pid=29015): stderr: | 20221213085740783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085740783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085740784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085740784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085740785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085740785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085740785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:42.206811 run osmo-stp_10.42.42.5(pid=29015): stdout: | (launched: 2022-12-13_08:57:40.612463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:42.329190 run osmo-stp_10.42.42.5(pid=29015): stderr: | 20221213085740783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085740783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085740784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085740784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085740785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085740785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085740785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:42.474729 run patchelf(pid=29018): Terminating (SIGINT) 08:57:42.642868 run patchelf(pid=29018): Terminated: ok {rc=0} 08:57:42.764496 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29015): Process ended prematurely: osmo-stp_10.42.42.5(pid=29015) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:57:42.774235 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:57:42.801444 run osmo-hlr_10.42.42.2(pid=29012): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29012)] 08:57:42.850284 run osmo-hlr_10.42.42.2(pid=29012): stdout: | (launched: 2022-12-13_08:57:39.688051) 08:57:42.900457 run osmo-hlr_10.42.42.2(pid=29012): stderr: | 20221213085739867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085739867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085739867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085739867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085739867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085739867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085739879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085739887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085739888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085739888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:42.950862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29001): Terminating (SIGTERM) 08:57:42.991665 run iperf3-srv_10.42.42.10(pid=29002): Terminating (SIGTERM) 08:57:43.032282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29003): Terminating (SIGTERM) 08:57:43.073060 run iperf3-srv_10.42.42.10(pid=29004): Terminating (SIGTERM) 08:57:43.113621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29005): Terminating (SIGTERM) 08:57:43.154295 run iperf3-srv_10.42.42.10(pid=29006): Terminating (SIGTERM) 08:57:43.194674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29007): Terminating (SIGTERM) 08:57:43.235379 run iperf3-srv_10.42.42.10(pid=29008): Terminating (SIGTERM) 08:57:43.275834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Terminating (SIGTERM) 08:57:43.316330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Terminating (SIGTERM) 08:57:43.357009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29017): Terminating (SIGTERM) 08:57:43.397685 --- ParallelTerminationStrategy: PID 29001 died... 08:57:43.417634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29001): Terminated: ok {rc=0} 08:57:43.462638 --- ParallelTerminationStrategy: PID 29002 died... 08:57:43.481984 run iperf3-srv_10.42.42.10(pid=29002): Terminated {rc=256} 08:57:43.526596 --- ParallelTerminationStrategy: PID 29003 died... 08:57:43.545965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29003): Terminated: ok {rc=0} 08:57:43.590700 --- ParallelTerminationStrategy: PID 29004 died... 08:57:43.610020 run iperf3-srv_10.42.42.10(pid=29004): Terminated {rc=256} 08:57:43.654351 --- ParallelTerminationStrategy: PID 29005 died... 08:57:43.673548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29005): Terminated: ok {rc=0} 08:57:43.717684 --- ParallelTerminationStrategy: PID 29006 died... 08:57:43.736646 run iperf3-srv_10.42.42.10(pid=29006): Terminated {rc=256} 08:57:43.780701 --- ParallelTerminationStrategy: PID 29007 died... 08:57:43.799844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29007): Terminated: ok {rc=0} 08:57:43.844013 --- ParallelTerminationStrategy: PID 29008 died... 08:57:43.863152 run iperf3-srv_10.42.42.10(pid=29008): Terminated {rc=256} 08:57:43.907166 --- ParallelTerminationStrategy: PID 29011 died... 08:57:43.926353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Terminated: ok {rc=0} 08:57:43.970439 --- ParallelTerminationStrategy: PID 29014 died... 08:57:43.989762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Terminated: ok {rc=0} 08:57:44.033927 --- ParallelTerminationStrategy: PID 29017 died... 08:57:44.053250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29017): Terminated: ok {rc=0} 08:57:44.139466 bus /gobi_4: Setting Powered False 08:57:45.237828 bus /gobi_4: Setting Powered False 08:57:46.350538 bus /gobi_1: Setting Powered False 08:57:47.444986 bus /gobi_1: Setting Powered False 08:57:48.559619 bus /gobi_0: Setting Powered False 08:57:49.658388 bus /gobi_0: Setting Powered False 08:57:50.774501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:57:51.878356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:51.890034 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:57:51.962077 tst ping.py: using LAC 32863 08:57:52.076118 tst ping.py: using RAC 223 08:57:52.191201 tst ping.py: using CellId 32863 08:57:52.307420 tst ping.py: using BVCI 32864 08:57:52.422924 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:52.434820 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:52.446329 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:52.457858 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:52.469374 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:52.480777 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:52.492661 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:52.504250 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:52.622304 tst ping.py:19: start network... 08:57:52.832443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:53.316173 run create_hlr_db(pid=29019): Launched 08:57:53.443084 bus /gobi_6: Setting Powered False 08:57:54.505339 run create_hlr_db(pid=29019): Terminated: ok {rc=0} 08:57:54.922140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29021): Launched 08:57:55.212568 run osmo-hlr_10.42.42.2(pid=29022): Launched 08:57:55.323768 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:55.843107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29024): Launched 08:57:56.134178 run osmo-stp_10.42.42.5(pid=29025): Launched 08:57:56.245045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:56.745892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29027): Launched 08:57:56.858156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:57.103663 run patchelf(pid=29028): Launched 08:57:57.265616 run osmo-stp_10.42.42.5(pid=29025): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29025)] 08:57:57.389615 run osmo-stp_10.42.42.5(pid=29025): stdout: | (launched: 2022-12-13_08:57:56.081180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:57.514844 run osmo-stp_10.42.42.5(pid=29025): stderr: | 20221213085756250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085756250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085756251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085756251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085756251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085756251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085756251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:57.640158 run osmo-stp_10.42.42.5(pid=29025): stdout: | (launched: 2022-12-13_08:57:56.081180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:57.760007 run osmo-stp_10.42.42.5(pid=29025): stderr: | 20221213085756250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085756250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085756251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085756251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085756251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085756251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085756251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:57.902147 run patchelf(pid=29028): Terminating (SIGINT) 08:57:58.065780 run patchelf(pid=29028): Terminated: ok {rc=0} 08:57:58.184049 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29025): Process ended prematurely: osmo-stp_10.42.42.5(pid=29025) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29025)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 08:57:58.192789 tst ping.py:22: Test FAILED (6.3 sec) 08:57:58.219483 run osmo-hlr_10.42.42.2(pid=29022): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29022)] 08:57:58.267640 run osmo-hlr_10.42.42.2(pid=29022): stdout: | (launched: 2022-12-13_08:57:55.159692) 08:57:58.317363 run osmo-hlr_10.42.42.2(pid=29022): stderr: | 20221213085755332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085755332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085755332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085755332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085755332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085755333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085755345 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085755356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085755356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085755356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:58.367257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29021): Terminating (SIGTERM) 08:57:58.407074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29024): Terminating (SIGTERM) 08:57:58.446887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29027): Terminating (SIGTERM) 08:57:58.487037 --- ParallelTerminationStrategy: PID 29021 died... 08:57:58.506385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29021): Terminated: ok {rc=0} 08:57:58.550473 --- ParallelTerminationStrategy: PID 29024 died... 08:57:58.569320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29024): Terminated: ok {rc=0} 08:57:58.613215 --- ParallelTerminationStrategy: PID 29027 died... 08:57:58.631878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29027): Terminated: ok {rc=0} 08:57:58.717840 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:57:59.804231 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:59.815648 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:57:59.885325 tst ping_idle_ping.py: using LAC 32864 08:58:00.001136 tst ping_idle_ping.py: using RAC 224 08:58:00.114817 tst ping_idle_ping.py: using CellId 32864 08:58:00.229056 tst ping_idle_ping.py: using BVCI 32865 08:58:00.336200 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:00.347150 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:00.357903 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:00.368487 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:00.379289 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:00.390911 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:00.402047 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:00.412879 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:58:00.526231 tst ping_idle_ping.py:24: start network... 08:58:00.722625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:01.206142 run create_hlr_db(pid=29030): Launched 08:58:01.320144 bus /gobi_6: Setting Powered False 08:58:02.386334 run create_hlr_db(pid=29030): Terminated: ok {rc=0} 08:58:02.815994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29032): Launched 08:58:03.129218 run osmo-hlr_10.42.42.2(pid=29033): Launched 08:58:03.248700 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:03.791473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29035): Launched 08:58:04.103580 run osmo-stp_10.42.42.5(pid=29036): Launched 08:58:04.223282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:04.762997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29038): Launched 08:58:04.882022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:05.146141 run patchelf(pid=29039): Launched 08:58:05.320043 run osmo-stp_10.42.42.5(pid=29036): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29036)] 08:58:05.452918 run osmo-stp_10.42.42.5(pid=29036): stdout: | (launched: 2022-12-13_08:58:04.047254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:05.587068 run osmo-stp_10.42.42.5(pid=29036): stderr: | 20221213085804239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085804239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085804240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085804240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085804240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085804240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085804241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:05.720811 run osmo-stp_10.42.42.5(pid=29036): stdout: | (launched: 2022-12-13_08:58:04.047254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:05.849369 run osmo-stp_10.42.42.5(pid=29036): stderr: | 20221213085804239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085804239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085804240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085804240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085804240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085804240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085804241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:06.001912 run patchelf(pid=29039): Terminating (SIGINT) 08:58:06.177276 run patchelf(pid=29039): Terminated: ok {rc=0} 08:58:06.303290 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29036): Process ended prematurely: osmo-stp_10.42.42.5(pid=29036) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29036)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:58:06.312641 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:58:06.340326 run osmo-hlr_10.42.42.2(pid=29033): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29033)] 08:58:06.389943 run osmo-hlr_10.42.42.2(pid=29033): stdout: | (launched: 2022-12-13_08:58:03.072768) 08:58:06.441444 run osmo-hlr_10.42.42.2(pid=29033): stderr: | 20221213085803268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085803268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085803268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085803268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085803268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085803268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085803281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085803289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085803290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085803290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:06.493438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29032): Terminating (SIGTERM) 08:58:06.534899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29035): Terminating (SIGTERM) 08:58:06.576320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29038): Terminating (SIGTERM) 08:58:06.618186 --- ParallelTerminationStrategy: PID 29032 died... 08:58:06.637551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29032): Terminated: ok {rc=0} 08:58:06.683376 --- ParallelTerminationStrategy: PID 29035 died... 08:58:06.702452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29035): Terminated: ok {rc=0} 08:58:06.747710 --- ParallelTerminationStrategy: PID 29038 died... 08:58:06.766829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29038): Terminated: ok {rc=0} 08:58:06.853501 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:58:08.158448 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:08.164796 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:58:08.199030 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:58:08.238189 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:58:08.326680 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:58:08.360711 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:58:08.400201 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:58:08.995079 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:58:09.046048 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.057300 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:58:09.128648 tst cs_paging_gprs_active.py: using LAC 32865 08:58:09.253441 tst cs_paging_gprs_active.py: using RAC 225 08:58:09.379878 tst cs_paging_gprs_active.py: using CellId 32865 08:58:09.506152 tst cs_paging_gprs_active.py: using BVCI 32866 08:58:09.621994 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.633295 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.644463 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.655621 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.666667 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.677810 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.688902 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.700006 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:09.711260 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:09.830446 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:09.945825 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:58:10.146017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:10.445344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Launched 08:58:10.705604 run iperf3-srv_10.42.42.10(pid=29049): Launched 08:58:10.817569 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:58:11.017526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:11.315716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Launched 08:58:11.574102 run iperf3-srv_10.42.42.10(pid=29051): Launched 08:58:11.686820 tst cs_paging_gprs_active.py:38: start network... 08:58:11.886140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:12.347222 run create_hlr_db(pid=29052): Launched 08:58:12.461790 bus /gobi_6: Setting Powered False 08:58:13.521552 run create_hlr_db(pid=29052): Terminated: ok {rc=0} 08:58:13.957310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29054): Launched 08:58:14.275686 run osmo-hlr_10.42.42.2(pid=29055): Launched 08:58:14.398269 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:14.949633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29057): Launched 08:58:15.266572 run osmo-stp_10.42.42.5(pid=29058): Launched 08:58:15.388839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:15.941680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29060): Launched 08:58:16.077566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:16.345951 run patchelf(pid=29061): Launched 08:58:16.525142 run osmo-stp_10.42.42.5(pid=29058): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29058)] 08:58:16.658589 run osmo-stp_10.42.42.5(pid=29058): stdout: | (launched: 2022-12-13_08:58:15.209363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:16.792538 run osmo-stp_10.42.42.5(pid=29058): stderr: | 20221213085815401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085815402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085815402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085815402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085815403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085815403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085815403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:16.925357 run osmo-stp_10.42.42.5(pid=29058): stdout: | (launched: 2022-12-13_08:58:15.209363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:17.074552 run osmo-stp_10.42.42.5(pid=29058): stderr: | 20221213085815401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085815402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085815402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085815402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085815403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085815403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085815403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:17.245757 run patchelf(pid=29061): Terminating (SIGINT) 08:58:17.416110 run patchelf(pid=29061): Terminated: ok {rc=0} 08:58:17.537983 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29058): Process ended prematurely: osmo-stp_10.42.42.5(pid=29058) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29058)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:58:17.547620 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 08:58:17.574988 run osmo-hlr_10.42.42.2(pid=29055): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29055)] 08:58:17.624010 run osmo-hlr_10.42.42.2(pid=29055): stdout: | (launched: 2022-12-13_08:58:14.217696) 08:58:17.673956 run osmo-hlr_10.42.42.2(pid=29055): stderr: | 20221213085814416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085814416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085814417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085814417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085814417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085814417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085814429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085814437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085814437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085814437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:17.723753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Terminating (SIGTERM) 08:58:17.763608 run iperf3-srv_10.42.42.10(pid=29049): Terminating (SIGTERM) 08:58:17.803306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Terminating (SIGTERM) 08:58:17.843134 run iperf3-srv_10.42.42.10(pid=29051): Terminating (SIGTERM) 08:58:17.882862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29054): Terminating (SIGTERM) 08:58:17.922772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29057): Terminating (SIGTERM) 08:58:17.962883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29060): Terminating (SIGTERM) 08:58:18.003103 --- ParallelTerminationStrategy: PID 29048 died... 08:58:18.022571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Terminated: ok {rc=0} 08:58:18.066973 --- ParallelTerminationStrategy: PID 29049 died... 08:58:18.085986 run iperf3-srv_10.42.42.10(pid=29049): Terminated {rc=256} 08:58:18.130087 --- ParallelTerminationStrategy: PID 29050 died... 08:58:18.148811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Terminated: ok {rc=0} 08:58:18.192578 --- ParallelTerminationStrategy: PID 29051 died... 08:58:18.211369 run iperf3-srv_10.42.42.10(pid=29051): Terminated {rc=256} 08:58:18.255522 --- ParallelTerminationStrategy: PID 29054 died... 08:58:18.274628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29054): Terminated: ok {rc=0} 08:58:18.318767 --- ParallelTerminationStrategy: PID 29057 died... 08:58:18.337697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29057): Terminated: ok {rc=0} 08:58:18.381590 --- ParallelTerminationStrategy: PID 29060 died... 08:58:18.400327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29060): Terminated: ok {rc=0} 08:58:18.484455 bus /gobi_0: Setting Powered False 08:58:19.581873 bus /gobi_0: Setting Powered False 08:58:20.697300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:58:21.839237 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:21.850643 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:58:21.926572 tst iperf3.py: using LAC 32866 08:58:22.052711 tst iperf3.py: using RAC 226 08:58:22.176326 tst iperf3.py: using CellId 32866 08:58:22.301141 tst iperf3.py: using BVCI 32867 08:58:22.418958 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.430489 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.441892 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.453133 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.465034 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.476927 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.488853 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.500665 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:22.512580 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:22.629185 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:58:22.829143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:23.129695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29062): Launched 08:58:23.405676 run iperf3-srv_10.42.42.10(pid=29063): Launched 08:58:23.525193 tst iperf3.py:8: start network... 08:58:23.739938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:24.232067 run create_hlr_db(pid=29064): Launched 08:58:24.360477 bus /gobi_6: Setting Powered False 08:58:25.423772 run create_hlr_db(pid=29064): Terminated: ok {rc=0} 08:58:25.863487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Launched 08:58:26.179797 run osmo-hlr_10.42.42.2(pid=29067): Launched 08:58:26.300645 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:26.847320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Launched 08:58:27.164903 run osmo-stp_10.42.42.5(pid=29070): Launched 08:58:27.286141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:27.834111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Launched 08:58:27.955341 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:28.223382 run patchelf(pid=29073): Launched 08:58:28.399983 run osmo-stp_10.42.42.5(pid=29070): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] 08:58:28.534459 run osmo-stp_10.42.42.5(pid=29070): stdout: | (launched: 2022-12-13_08:58:27.106563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:28.670179 run osmo-stp_10.42.42.5(pid=29070): stderr: | 20221213085827299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085827299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085827299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085827299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085827300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085827300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085827300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:28.805860 run osmo-stp_10.42.42.5(pid=29070): stdout: | (launched: 2022-12-13_08:58:27.106563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:28.936434 run osmo-stp_10.42.42.5(pid=29070): stderr: | 20221213085827299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085827299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085827299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085827299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085827300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085827300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085827300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:29.090983 run patchelf(pid=29073): Terminating (SIGINT) 08:58:29.268641 run patchelf(pid=29073): Terminated: ok {rc=0} 08:58:29.397261 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29070): Process ended prematurely: osmo-stp_10.42.42.5(pid=29070) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 08:58:29.407201 tst iperf3.py:8: Test FAILED (7.6 sec) 08:58:29.435638 run osmo-hlr_10.42.42.2(pid=29067): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29067)] 08:58:29.485645 run osmo-hlr_10.42.42.2(pid=29067): stdout: | (launched: 2022-12-13_08:58:26.122359) 08:58:29.537511 run osmo-hlr_10.42.42.2(pid=29067): stderr: | 20221213085826319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085826319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085826320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085826320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085826320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085826320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085826331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085826339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085826340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085826340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:29.589854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29062): Terminating (SIGTERM) 08:58:29.631660 run iperf3-srv_10.42.42.10(pid=29063): Terminating (SIGTERM) 08:58:29.673677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Terminating (SIGTERM) 08:58:29.715533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Terminating (SIGTERM) 08:58:29.757677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Terminating (SIGTERM) 08:58:29.799700 --- ParallelTerminationStrategy: PID 29062 died... 08:58:29.819651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29062): Terminated: ok {rc=0} 08:58:29.866007 --- ParallelTerminationStrategy: PID 29063 died... 08:58:29.885811 run iperf3-srv_10.42.42.10(pid=29063): Terminated {rc=256} 08:58:29.931774 --- ParallelTerminationStrategy: PID 29066 died... 08:58:29.951375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Terminated: ok {rc=0} 08:58:29.997944 --- ParallelTerminationStrategy: PID 29069 died... 08:58:30.017484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Terminated: ok {rc=0} 08:58:30.063535 --- ParallelTerminationStrategy: PID 29072 died... 08:58:30.083012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Terminated: ok {rc=0} 08:58:30.169577 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:58:31.321312 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:31.337768 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:58:31.412293 tst iperf3m4.py: using LAC 32867 08:58:31.576859 tst iperf3m4.py: using RAC 227 08:58:31.705732 tst iperf3m4.py: using CellId 32867 08:58:31.833595 tst iperf3m4.py: using BVCI 32868 08:58:31.945263 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:31.956762 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:31.968117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:31.979483 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:31.991628 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:32.004085 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:32.016693 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:32.028863 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:32.041507 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:32.161903 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:32.289351 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:32.413658 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:32.535062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:58:32.751113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:33.070523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29074): Launched 08:58:33.346092 run iperf3-srv_10.42.42.10(pid=29075): Launched 08:58:33.465176 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:58:33.680570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:34.000375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29076): Launched 08:58:34.276054 run iperf3-srv_10.42.42.10(pid=29077): Launched 08:58:34.395321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:58:34.609896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:34.928729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29078): Launched 08:58:35.204129 run iperf3-srv_10.42.42.10(pid=29079): Launched 08:58:35.323066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:58:35.537090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:35.855043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29080): Launched 08:58:36.131051 run iperf3-srv_10.42.42.10(pid=29081): Launched 08:58:36.249767 tst iperf3m4.py:8: start network... 08:58:36.463809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:36.959918 run create_hlr_db(pid=29082): Launched 08:58:37.088208 bus /gobi_6: Setting Powered False 08:58:38.152063 run create_hlr_db(pid=29082): Terminated: ok {rc=0} 08:58:38.594866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29084): Launched 08:58:38.912364 run osmo-hlr_10.42.42.2(pid=29085): Launched 08:58:39.033265 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:39.579387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29087): Launched 08:58:39.896162 run osmo-stp_10.42.42.5(pid=29088): Launched 08:58:40.017529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:40.567453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29090): Launched 08:58:40.688227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:40.956616 run patchelf(pid=29091): Launched 08:58:41.133206 run osmo-stp_10.42.42.5(pid=29088): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29088)] 08:58:41.267784 run osmo-stp_10.42.42.5(pid=29088): stdout: | (launched: 2022-12-13_08:58:39.838145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:41.403863 run osmo-stp_10.42.42.5(pid=29088): stderr: | 20221213085840030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085840030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085840031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085840031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085840032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085840032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085840032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:41.539776 run osmo-stp_10.42.42.5(pid=29088): stdout: | (launched: 2022-12-13_08:58:39.838145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:41.669985 run osmo-stp_10.42.42.5(pid=29088): stderr: | 20221213085840030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085840030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085840031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085840031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085840032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085840032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085840032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:41.824277 run patchelf(pid=29091): Terminating (SIGINT) 08:58:42.002813 run patchelf(pid=29091): Terminated: ok {rc=0} 08:58:42.131162 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29088): Process ended prematurely: osmo-stp_10.42.42.5(pid=29088) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29088)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:58:42.141233 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:58:42.169514 run osmo-hlr_10.42.42.2(pid=29085): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29085)] 08:58:42.219653 run osmo-hlr_10.42.42.2(pid=29085): stdout: | (launched: 2022-12-13_08:58:38.854355) 08:58:42.271288 run osmo-hlr_10.42.42.2(pid=29085): stderr: | 20221213085839052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085839052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085839052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085839053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085839053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085839053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085839065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085839073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085839074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085839074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:42.323440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29074): Terminating (SIGTERM) 08:58:42.365410 run iperf3-srv_10.42.42.10(pid=29075): Terminating (SIGTERM) 08:58:42.406981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29076): Terminating (SIGTERM) 08:58:42.449070 run iperf3-srv_10.42.42.10(pid=29077): Terminating (SIGTERM) 08:58:42.491631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29078): Terminating (SIGTERM) 08:58:42.533949 run iperf3-srv_10.42.42.10(pid=29079): Terminating (SIGTERM) 08:58:42.576061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29080): Terminating (SIGTERM) 08:58:42.618250 run iperf3-srv_10.42.42.10(pid=29081): Terminating (SIGTERM) 08:58:42.659749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29084): Terminating (SIGTERM) 08:58:42.701691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29087): Terminating (SIGTERM) 08:58:42.743098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29090): Terminating (SIGTERM) 08:58:42.784766 --- ParallelTerminationStrategy: PID 29074 died... 08:58:42.804699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29074): Terminated: ok {rc=0} 08:58:42.850660 --- ParallelTerminationStrategy: PID 29075 died... 08:58:42.870315 run iperf3-srv_10.42.42.10(pid=29075): Terminated {rc=256} 08:58:42.916113 --- ParallelTerminationStrategy: PID 29076 died... 08:58:42.935570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29076): Terminated: ok {rc=0} 08:58:42.981209 --- ParallelTerminationStrategy: PID 29077 died... 08:58:43.000404 run iperf3-srv_10.42.42.10(pid=29077): Terminated {rc=256} 08:58:43.046006 --- ParallelTerminationStrategy: PID 29078 died... 08:58:43.065419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29078): Terminated: ok {rc=0} 08:58:43.110967 --- ParallelTerminationStrategy: PID 29079 died... 08:58:43.130378 run iperf3-srv_10.42.42.10(pid=29079): Terminated {rc=256} 08:58:43.175807 --- ParallelTerminationStrategy: PID 29080 died... 08:58:43.195210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29080): Terminated: ok {rc=0} 08:58:43.240831 --- ParallelTerminationStrategy: PID 29081 died... 08:58:43.260261 run iperf3-srv_10.42.42.10(pid=29081): Terminated {rc=256} 08:58:43.305750 --- ParallelTerminationStrategy: PID 29084 died... 08:58:43.325035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29084): Terminated: ok {rc=0} 08:58:43.370402 --- ParallelTerminationStrategy: PID 29087 died... 08:58:43.389735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29087): Terminated: ok {rc=0} 08:58:43.435312 --- ParallelTerminationStrategy: PID 29090 died... 08:58:43.454768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29090): Terminated: ok {rc=0} 08:58:43.541766 bus /gobi_4: Setting Powered False 08:58:44.639333 bus /gobi_4: Setting Powered False 08:58:45.754762 bus /gobi_1: Setting Powered False 08:58:46.851508 bus /gobi_1: Setting Powered False 08:58:47.967326 bus /gobi_0: Setting Powered False 08:58:49.065447 bus /gobi_0: Setting Powered False 08:58:50.181472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:58:51.280571 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.291894 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:58:51.362465 tst ping.py: using LAC 32868 08:58:51.482319 tst ping.py: using RAC 228 08:58:51.600204 tst ping.py: using CellId 32868 08:58:51.716254 tst ping.py: using BVCI 32869 08:58:51.822548 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.833504 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.844097 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.854731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.865659 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.877794 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.889676 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:51.901219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:52.020300 tst ping.py:19: start network... 08:58:52.230034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:52.712797 run create_hlr_db(pid=29092): Launched 08:58:52.839488 bus /gobi_6: Setting Powered False 08:58:53.901293 run create_hlr_db(pid=29092): Terminated: ok {rc=0} 08:58:54.318807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29094): Launched 08:58:54.610632 run osmo-hlr_10.42.42.2(pid=29095): Launched 08:58:54.721964 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:55.268297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29097): Launched 08:58:55.579759 run osmo-stp_10.42.42.5(pid=29098): Launched 08:58:55.699588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:56.238158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29100): Launched 08:58:56.357306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:56.619562 run patchelf(pid=29101): Launched 08:58:56.793041 run osmo-stp_10.42.42.5(pid=29098): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29098)] 08:58:56.925867 run osmo-stp_10.42.42.5(pid=29098): stdout: | (launched: 2022-12-13_08:58:55.523416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:57.059859 run osmo-stp_10.42.42.5(pid=29098): stderr: | 20221213085855713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085855713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085855713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085855714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085855714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085855714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085855714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:57.193846 run osmo-stp_10.42.42.5(pid=29098): stdout: | (launched: 2022-12-13_08:58:55.523416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:57.322085 run osmo-stp_10.42.42.5(pid=29098): stderr: | 20221213085855713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085855713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085855713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085855714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085855714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085855714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085855714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:57.474081 run patchelf(pid=29101): Terminating (SIGINT) 08:58:57.648845 run patchelf(pid=29101): Terminated: ok {rc=0} 08:58:57.775085 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29098): Process ended prematurely: osmo-stp_10.42.42.5(pid=29098) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29098)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 08:58:57.784632 tst ping.py:22: Test FAILED (6.5 sec) 08:58:57.812502 run osmo-hlr_10.42.42.2(pid=29095): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29095)] 08:58:57.862503 run osmo-hlr_10.42.42.2(pid=29095): stdout: | (launched: 2022-12-13_08:58:54.557587) 08:58:57.914392 run osmo-hlr_10.42.42.2(pid=29095): stderr: | 20221213085854731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085854731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085854731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085854731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085854731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085854731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085854743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085854752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085854752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085854753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:57.966326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29094): Terminating (SIGTERM) 08:58:58.008016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29097): Terminating (SIGTERM) 08:58:58.049866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29100): Terminating (SIGTERM) 08:58:58.091852 --- ParallelTerminationStrategy: PID 29094 died... 08:58:58.112087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29094): Terminated: ok {rc=0} 08:58:58.158467 --- ParallelTerminationStrategy: PID 29097 died... 08:58:58.178196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29097): Terminated: ok {rc=0} 08:58:58.225569 --- ParallelTerminationStrategy: PID 29100 died... 08:58:58.245311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29100): Terminated: ok {rc=0} 08:58:58.332323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:58:59.419225 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:59.430723 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:58:59.501799 tst ping_idle_ping.py: using LAC 32869 08:58:59.621892 tst ping_idle_ping.py: using RAC 229 08:58:59.737643 tst ping_idle_ping.py: using CellId 32869 08:58:59.860758 tst ping_idle_ping.py: using BVCI 32870 08:58:59.974518 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:59.985818 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:59.996939 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:00.008267 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:00.019446 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:00.030718 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:00.041896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:00.052898 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:59:00.167142 tst ping_idle_ping.py:24: start network... 08:59:00.363401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:00.818723 run create_hlr_db(pid=29102): Launched 08:59:00.932243 bus /gobi_6: Setting Powered False 08:59:02.017661 run create_hlr_db(pid=29102): Terminated: ok {rc=0} 08:59:02.509411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29104): Launched 08:59:02.821654 run osmo-hlr_10.42.42.2(pid=29105): Launched 08:59:02.941219 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:03.478412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29107): Launched 08:59:03.790251 run osmo-stp_10.42.42.5(pid=29108): Launched 08:59:03.909944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:04.449119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29110): Launched 08:59:04.568484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:04.832472 run patchelf(pid=29111): Launched 08:59:05.007090 run osmo-stp_10.42.42.5(pid=29108): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29108)] 08:59:05.139950 run osmo-stp_10.42.42.5(pid=29108): stdout: | (launched: 2022-12-13_08:59:03.733780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:05.274343 run osmo-stp_10.42.42.5(pid=29108): stderr: | 20221213085903923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085903923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085903923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085903924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085903926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085903926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085903926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:05.408570 run osmo-stp_10.42.42.5(pid=29108): stdout: | (launched: 2022-12-13_08:59:03.733780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:05.537460 run osmo-stp_10.42.42.5(pid=29108): stderr: | 20221213085903923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085903923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085903923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085903924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085903926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085903926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085903926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:05.690008 run patchelf(pid=29111): Terminating (SIGINT) 08:59:05.864872 run patchelf(pid=29111): Terminated: ok {rc=0} 08:59:05.991530 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29108): Process ended prematurely: osmo-stp_10.42.42.5(pid=29108) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29108)] [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:59:06.001176 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:59:06.028896 run osmo-hlr_10.42.42.2(pid=29105): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29105)] 08:59:06.078549 run osmo-hlr_10.42.42.2(pid=29105): stdout: | (launched: 2022-12-13_08:59:02.765404) 08:59:06.129999 run osmo-hlr_10.42.42.2(pid=29105): stderr: | 20221213085902962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085902962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085902962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085902962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085902962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085902962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085902981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085902991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085902991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085902991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:06.181979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29104): Terminating (SIGTERM) 08:59:06.223695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29107): Terminating (SIGTERM) 08:59:06.265451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29110): Terminating (SIGTERM) 08:59:06.307319 --- ParallelTerminationStrategy: PID 29104 died... 08:59:06.327225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29104): Terminated: ok {rc=0} 08:59:06.373409 --- ParallelTerminationStrategy: PID 29107 died... 08:59:06.393129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29107): Terminated: ok {rc=0} 08:59:06.439472 --- ParallelTerminationStrategy: PID 29110 died... 08:59:06.459382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29110): Terminated: ok {rc=0} 08:59:06.547384 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:59:07.854915 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:07.861803 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:59:07.895861 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 08:59:07.935542 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 08:59:08.024362 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:59:08.058095 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 08:59:08.097649 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 08:59:08.692720 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 08:59:08.741768 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:08.753299 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:59:08.804638 tst cs_paging_gprs_active.py: using LAC 32870 08:59:08.921738 tst cs_paging_gprs_active.py: using RAC 230 08:59:09.039294 tst cs_paging_gprs_active.py: using CellId 32870 08:59:09.158237 tst cs_paging_gprs_active.py: using BVCI 32871 08:59:09.268772 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.280473 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.291600 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.302629 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.314103 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.325650 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.337061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.348685 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:09.360604 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:09.481796 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:09.603880 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:59:09.819604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:10.139526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Launched 08:59:10.416493 run iperf3-srv_10.42.42.10(pid=29116): Launched 08:59:10.535915 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:59:10.751602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:11.071279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Launched 08:59:11.347775 run iperf3-srv_10.42.42.10(pid=29118): Launched 08:59:11.466805 tst cs_paging_gprs_active.py:38: start network... 08:59:11.681226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:12.174724 run create_hlr_db(pid=29119): Launched 08:59:12.303896 bus /gobi_6: Setting Powered False 08:59:13.368021 run create_hlr_db(pid=29119): Terminated: ok {rc=0} 08:59:13.810908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29121): Launched 08:59:14.128090 run osmo-hlr_10.42.42.2(pid=29122): Launched 08:59:14.249938 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:14.767803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29124): Launched 08:59:15.065320 run osmo-stp_10.42.42.5(pid=29125): Launched 08:59:15.179776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:15.694199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29127): Launched 08:59:15.808332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:16.106369 run patchelf(pid=29128): Launched 08:59:16.301237 run osmo-stp_10.42.42.5(pid=29125): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29125)] 08:59:16.441586 run osmo-stp_10.42.42.5(pid=29125): stdout: | (launched: 2022-12-13_08:59:15.011249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:16.583382 run osmo-stp_10.42.42.5(pid=29125): stderr: | 20221213085915181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085915182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085915182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085915182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085915183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085915183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085915183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:16.723398 run osmo-stp_10.42.42.5(pid=29125): stdout: | (launched: 2022-12-13_08:59:15.011249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:16.859059 run osmo-stp_10.42.42.5(pid=29125): stderr: | 20221213085915181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085915182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085915182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085915182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085915183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085915183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085915183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:17.019137 run patchelf(pid=29128): Terminating (SIGINT) 08:59:17.202465 run patchelf(pid=29128): Terminated: ok {rc=0} 08:59:17.331134 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29125): Process ended prematurely: osmo-stp_10.42.42.5(pid=29125) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29125)] [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 08:59:17.341417 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:59:17.370495 run osmo-hlr_10.42.42.2(pid=29122): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29122)] 08:59:17.420749 run osmo-hlr_10.42.42.2(pid=29122): stdout: | (launched: 2022-12-13_08:59:14.070869) 08:59:17.473440 run osmo-hlr_10.42.42.2(pid=29122): stderr: | 20221213085914269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085914269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085914269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085914269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085914269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085914269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085914282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085914290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085914290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085914290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:17.526387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Terminating (SIGTERM) 08:59:17.568629 run iperf3-srv_10.42.42.10(pid=29116): Terminating (SIGTERM) 08:59:17.611024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Terminating (SIGTERM) 08:59:17.653137 run iperf3-srv_10.42.42.10(pid=29118): Terminating (SIGTERM) 08:59:17.695514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29121): Terminating (SIGTERM) 08:59:17.737717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29124): Terminating (SIGTERM) 08:59:17.779368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29127): Terminating (SIGTERM) 08:59:17.821292 --- ParallelTerminationStrategy: PID 29115 died... 08:59:17.841370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Terminated: ok {rc=0} 08:59:17.887555 --- ParallelTerminationStrategy: PID 29116 died... 08:59:17.907456 run iperf3-srv_10.42.42.10(pid=29116): Terminated {rc=256} 08:59:17.953345 --- ParallelTerminationStrategy: PID 29117 died... 08:59:17.972993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Terminated: ok {rc=0} 08:59:18.018738 --- ParallelTerminationStrategy: PID 29118 died... 08:59:18.038330 run iperf3-srv_10.42.42.10(pid=29118): Terminated {rc=256} 08:59:18.084193 --- ParallelTerminationStrategy: PID 29121 died... 08:59:18.103958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29121): Terminated: ok {rc=0} 08:59:18.150527 --- ParallelTerminationStrategy: PID 29124 died... 08:59:18.170152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29124): Terminated: ok {rc=0} 08:59:18.216215 --- ParallelTerminationStrategy: PID 29127 died... 08:59:18.235958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29127): Terminated: ok {rc=0} 08:59:18.323139 bus /gobi_0: Setting Powered False 08:59:19.422023 bus /gobi_0: Setting Powered False 08:59:20.537115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 08:59:21.684076 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:21.696521 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:59:21.753683 tst iperf3.py: using LAC 32871 08:59:21.883686 tst iperf3.py: using RAC 231 08:59:22.008640 tst iperf3.py: using CellId 32871 08:59:22.135707 tst iperf3.py: using BVCI 32872 08:59:22.252558 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.264323 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.275845 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.287277 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.299068 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.310481 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.322135 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.333514 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:22.345129 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:22.460211 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:59:22.661521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:22.960743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29129): Launched 08:59:23.219117 run iperf3-srv_10.42.42.10(pid=29130): Launched 08:59:23.331167 tst iperf3.py:8: start network... 08:59:23.530268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:23.988670 run create_hlr_db(pid=29131): Launched 08:59:24.102272 bus /gobi_6: Setting Powered False 08:59:25.161877 run create_hlr_db(pid=29131): Terminated: ok {rc=0} 08:59:25.574280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29133): Launched 08:59:25.869241 run osmo-hlr_10.42.42.2(pid=29134): Launched 08:59:25.982267 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:26.496384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29136): Launched 08:59:26.792350 run osmo-stp_10.42.42.5(pid=29137): Launched 08:59:26.906403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:27.416673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29139): Launched 08:59:27.530085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:27.779973 run patchelf(pid=29140): Launched 08:59:27.945192 run osmo-stp_10.42.42.5(pid=29137): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29137)] 08:59:28.071289 run osmo-stp_10.42.42.5(pid=29137): stdout: | (launched: 2022-12-13_08:59:26.738298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:28.199530 run osmo-stp_10.42.42.5(pid=29137): stderr: | 20221213085926908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085926908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085926908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085926909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085926909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085926910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085926910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:28.327319 run osmo-stp_10.42.42.5(pid=29137): stdout: | (launched: 2022-12-13_08:59:26.738298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:28.449624 run osmo-stp_10.42.42.5(pid=29137): stderr: | 20221213085926908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085926908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085926908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085926909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085926909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085926910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085926910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:28.594225 run patchelf(pid=29140): Terminating (SIGINT) 08:59:28.761323 run patchelf(pid=29140): Terminated: ok {rc=0} 08:59:28.882408 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29137): Process ended prematurely: osmo-stp_10.42.42.5(pid=29137) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29137)] [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 08:59:28.891781 tst iperf3.py:8: Test FAILED (7.2 sec) 08:59:28.918647 run osmo-hlr_10.42.42.2(pid=29134): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29134)] 08:59:28.966526 run osmo-hlr_10.42.42.2(pid=29134): stdout: | (launched: 2022-12-13_08:59:25.815716) 08:59:29.015730 run osmo-hlr_10.42.42.2(pid=29134): stderr: | 20221213085925990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085925990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085925990 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085925991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085925991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085925991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085926002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085926011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085926011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085926011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:29.065401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29129): Terminating (SIGTERM) 08:59:29.105226 run iperf3-srv_10.42.42.10(pid=29130): Terminating (SIGTERM) 08:59:29.144833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29133): Terminating (SIGTERM) 08:59:29.184649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29136): Terminating (SIGTERM) 08:59:29.224541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29139): Terminating (SIGTERM) 08:59:29.264540 --- ParallelTerminationStrategy: PID 29129 died... 08:59:29.283875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29129): Terminated: ok {rc=0} 08:59:29.327801 --- ParallelTerminationStrategy: PID 29130 died... 08:59:29.346706 run iperf3-srv_10.42.42.10(pid=29130): Terminated {rc=256} 08:59:29.390391 --- ParallelTerminationStrategy: PID 29133 died... 08:59:29.409144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29133): Terminated: ok {rc=0} 08:59:29.452863 --- ParallelTerminationStrategy: PID 29136 died... 08:59:29.472240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29136): Terminated: ok {rc=0} 08:59:29.516165 --- ParallelTerminationStrategy: PID 29139 died... 08:59:29.534963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29139): Terminated: ok {rc=0} 08:59:29.620251 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 08:59:30.765185 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:30.777133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:59:30.830289 tst iperf3m4.py: using LAC 32872 08:59:30.955302 tst iperf3m4.py: using RAC 232 08:59:31.100267 tst iperf3m4.py: using CellId 32872 08:59:31.262505 tst iperf3m4.py: using BVCI 32873 08:59:31.421479 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.434308 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.446891 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.459493 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.472738 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.486262 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.499599 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.512863 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:31.526072 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:31.644817 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:31.778369 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:31.916742 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:32.054082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:59:32.281328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:32.603531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29141): Launched 08:59:32.879896 run iperf3-srv_10.42.42.10(pid=29142): Launched 08:59:33.000164 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:59:33.215307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:33.521062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29143): Launched 08:59:33.780327 run iperf3-srv_10.42.42.10(pid=29144): Launched 08:59:33.892443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:59:34.092907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:34.391286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29145): Launched 08:59:34.649742 run iperf3-srv_10.42.42.10(pid=29146): Launched 08:59:34.761496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:59:34.961677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:35.259322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29147): Launched 08:59:35.517302 run iperf3-srv_10.42.42.10(pid=29148): Launched 08:59:35.628931 tst iperf3m4.py:8: start network... 08:59:35.829162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:36.287967 run create_hlr_db(pid=29149): Launched 08:59:36.402880 bus /gobi_6: Setting Powered False 08:59:37.462408 run create_hlr_db(pid=29149): Terminated: ok {rc=0} 08:59:37.896328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29151): Launched 08:59:38.213601 run osmo-hlr_10.42.42.2(pid=29152): Launched 08:59:38.335047 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:38.886189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29154): Launched 08:59:39.204467 run osmo-stp_10.42.42.5(pid=29155): Launched 08:59:39.325671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:39.873669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29157): Launched 08:59:39.996350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:40.263571 run patchelf(pid=29158): Launched 08:59:40.439894 run osmo-stp_10.42.42.5(pid=29155): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29155)] 08:59:40.573934 run osmo-stp_10.42.42.5(pid=29155): stdout: | (launched: 2022-12-13_08:59:39.146575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:40.709231 run osmo-stp_10.42.42.5(pid=29155): stderr: | 20221213085939338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085939338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085939339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085939339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085939339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085939339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085939339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:40.844624 run osmo-stp_10.42.42.5(pid=29155): stdout: | (launched: 2022-12-13_08:59:39.146575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:40.975356 run osmo-stp_10.42.42.5(pid=29155): stderr: | 20221213085939338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085939338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085939339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085939339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085939339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085939339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085939339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:41.129573 run patchelf(pid=29158): Terminating (SIGINT) 08:59:41.307159 run patchelf(pid=29158): Terminated: ok {rc=0} 08:59:41.435106 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29155): Process ended prematurely: osmo-stp_10.42.42.5(pid=29155) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29155)] [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 08:59:41.445285 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:59:41.473628 run osmo-hlr_10.42.42.2(pid=29152): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29152)] 08:59:41.523196 run osmo-hlr_10.42.42.2(pid=29152): stdout: | (launched: 2022-12-13_08:59:38.156402) 08:59:41.574417 run osmo-hlr_10.42.42.2(pid=29152): stderr: | 20221213085938352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085938352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085938352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085938352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085938352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085938352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085938364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085938372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085938372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085938372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:41.625848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29141): Terminating (SIGTERM) 08:59:41.667319 run iperf3-srv_10.42.42.10(pid=29142): Terminating (SIGTERM) 08:59:41.708804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29143): Terminating (SIGTERM) 08:59:41.750582 run iperf3-srv_10.42.42.10(pid=29144): Terminating (SIGTERM) 08:59:41.791954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29145): Terminating (SIGTERM) 08:59:41.833554 run iperf3-srv_10.42.42.10(pid=29146): Terminating (SIGTERM) 08:59:41.874983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29147): Terminating (SIGTERM) 08:59:41.917041 run iperf3-srv_10.42.42.10(pid=29148): Terminating (SIGTERM) 08:59:41.958357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29151): Terminating (SIGTERM) 08:59:41.999761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29154): Terminating (SIGTERM) 08:59:42.041211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29157): Terminating (SIGTERM) 08:59:42.082984 --- ParallelTerminationStrategy: PID 29141 died... 08:59:42.103020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29141): Terminated: ok {rc=0} 08:59:42.148606 --- ParallelTerminationStrategy: PID 29142 died... 08:59:42.167939 run iperf3-srv_10.42.42.10(pid=29142): Terminated {rc=256} 08:59:42.213222 --- ParallelTerminationStrategy: PID 29143 died... 08:59:42.232521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29143): Terminated: ok {rc=0} 08:59:42.278116 --- ParallelTerminationStrategy: PID 29144 died... 08:59:42.297543 run iperf3-srv_10.42.42.10(pid=29144): Terminated {rc=256} 08:59:42.342925 --- ParallelTerminationStrategy: PID 29145 died... 08:59:42.362402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29145): Terminated: ok {rc=0} 08:59:42.407700 --- ParallelTerminationStrategy: PID 29146 died... 08:59:42.426989 run iperf3-srv_10.42.42.10(pid=29146): Terminated {rc=256} 08:59:42.472056 --- ParallelTerminationStrategy: PID 29147 died... 08:59:42.491438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29147): Terminated: ok {rc=0} 08:59:42.536647 --- ParallelTerminationStrategy: PID 29148 died... 08:59:42.555965 run iperf3-srv_10.42.42.10(pid=29148): Terminated {rc=256} 08:59:42.601085 --- ParallelTerminationStrategy: PID 29151 died... 08:59:42.620331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29151): Terminated: ok {rc=0} 08:59:42.665831 --- ParallelTerminationStrategy: PID 29154 died... 08:59:42.685295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29154): Terminated: ok {rc=0} 08:59:42.730566 --- ParallelTerminationStrategy: PID 29157 died... 08:59:42.749941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29157): Terminated: ok {rc=0} 08:59:42.836448 bus /gobi_4: Setting Powered False 08:59:43.935960 bus /gobi_4: Setting Powered False 08:59:45.053337 bus /gobi_1: Setting Powered False 08:59:46.166663 bus /gobi_1: Setting Powered False 08:59:47.297796 bus /gobi_0: Setting Powered False 08:59:48.396751 bus /gobi_0: Setting Powered False 08:59:49.508822 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 08:59:50.610525 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:50.622884 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:59:50.677577 tst ping.py: using LAC 32873 08:59:50.793854 tst ping.py: using RAC 233 08:59:50.910550 tst ping.py: using CellId 32873 08:59:51.027912 tst ping.py: using BVCI 32874 08:59:51.133595 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:51.145083 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:51.156591 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:51.167845 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:51.179424 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:51.190892 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:51.202479 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:51.213948 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:51.333371 tst ping.py:19: start network... 08:59:51.544384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:52.027615 run create_hlr_db(pid=29159): Launched 08:59:52.154880 bus /gobi_6: Setting Powered False 08:59:53.217120 run create_hlr_db(pid=29159): Terminated: ok {rc=0} 08:59:53.632806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29161): Launched 08:59:53.923979 run osmo-hlr_10.42.42.2(pid=29162): Launched 08:59:54.035211 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:54.555885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29164): Launched 08:59:54.846652 run osmo-stp_10.42.42.5(pid=29165): Launched 08:59:54.957826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:55.459412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29167): Launched 08:59:55.571583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:55.818116 run patchelf(pid=29168): Launched 08:59:55.981181 run osmo-stp_10.42.42.5(pid=29165): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29165)] 08:59:56.111902 run osmo-stp_10.42.42.5(pid=29165): stdout: | (launched: 2022-12-13_08:59:54.793768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:56.246119 run osmo-stp_10.42.42.5(pid=29165): stderr: | 20221213085954959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085954960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085954960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085954961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085954964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085954964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085954964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:56.380197 run osmo-stp_10.42.42.5(pid=29165): stdout: | (launched: 2022-12-13_08:59:54.793768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:56.508754 run osmo-stp_10.42.42.5(pid=29165): stderr: | 20221213085954959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213085954960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213085954960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213085954961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213085954964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213085954964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213085954964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:56.661526 run patchelf(pid=29168): Terminating (SIGINT) 08:59:56.836203 run patchelf(pid=29168): Terminated: ok {rc=0} 08:59:56.962847 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29165): Process ended prematurely: osmo-stp_10.42.42.5(pid=29165) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29165)] [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 08:59:56.972574 tst ping.py:22: Test FAILED (6.4 sec) 08:59:57.000416 run osmo-hlr_10.42.42.2(pid=29162): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29162)] 08:59:57.050564 run osmo-hlr_10.42.42.2(pid=29162): stdout: | (launched: 2022-12-13_08:59:53.871400) 08:59:57.102073 run osmo-hlr_10.42.42.2(pid=29162): stderr: | 20221213085954044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213085954044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213085954044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213085954044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213085954044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213085954045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213085954056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213085954065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213085954065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213085954065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:57.154013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29161): Terminating (SIGTERM) 08:59:57.195265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29164): Terminating (SIGTERM) 08:59:57.236646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29167): Terminating (SIGTERM) 08:59:57.278557 --- ParallelTerminationStrategy: PID 29161 died... 08:59:57.298623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29161): Terminated: ok {rc=0} 08:59:57.344254 --- ParallelTerminationStrategy: PID 29164 died... 08:59:57.363810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29164): Terminated: ok {rc=0} 08:59:57.409313 --- ParallelTerminationStrategy: PID 29167 died... 08:59:57.428679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29167): Terminated: ok {rc=0} 08:59:57.518557 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 08:59:58.605483 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:58.617508 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:59:58.672042 tst ping_idle_ping.py: using LAC 32874 08:59:58.797297 tst ping_idle_ping.py: using RAC 234 08:59:58.920626 tst ping_idle_ping.py: using CellId 32874 08:59:59.043806 tst ping_idle_ping.py: using BVCI 32875 08:59:59.158470 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:59.170582 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:59.182359 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:59.193886 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:59.205573 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:59.217248 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:59.229101 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:59:59.240820 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:59:59.357259 tst ping_idle_ping.py:24: start network... 08:59:59.568300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:00.056487 run create_hlr_db(pid=29169): Launched 09:00:00.183364 bus /gobi_6: Setting Powered False 09:00:01.245453 run create_hlr_db(pid=29169): Terminated: ok {rc=0} 09:00:01.746473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29171): Launched 09:00:02.119127 run osmo-hlr_10.42.42.2(pid=29179): Launched 09:00:02.281122 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:03.028207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29196): Launched 09:00:03.321107 run osmo-stp_10.42.42.5(pid=29197): Launched 09:00:03.432937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:03.951338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29199): Launched 09:00:04.063143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:04.309278 run patchelf(pid=29200): Launched 09:00:04.472322 run osmo-stp_10.42.42.5(pid=29197): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29197)] 09:00:04.596526 run osmo-stp_10.42.42.5(pid=29197): stdout: | (launched: 2022-12-13_09:00:03.268231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:04.722473 run osmo-stp_10.42.42.5(pid=29197): stderr: | 20221213090003438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090003439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090003439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090003439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090003440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090003440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090003440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:04.848490 run osmo-stp_10.42.42.5(pid=29197): stdout: | (launched: 2022-12-13_09:00:03.268231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:04.969359 run osmo-stp_10.42.42.5(pid=29197): stderr: | 20221213090003438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090003439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090003439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090003439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090003440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090003440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090003440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:05.111980 run patchelf(pid=29200): Terminating (SIGINT) 09:00:05.276686 run patchelf(pid=29200): Terminated: ok {rc=0} 09:00:05.395361 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29197): Process ended prematurely: osmo-stp_10.42.42.5(pid=29197) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29197)] [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:00:05.404254 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 09:00:05.430602 run osmo-hlr_10.42.42.2(pid=29179): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29179)] 09:00:05.478053 run osmo-hlr_10.42.42.2(pid=29179): stdout: | (launched: 2022-12-13_09:00:02.057492) 09:00:05.527193 run osmo-hlr_10.42.42.2(pid=29179): stderr: | 20221213090002428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090002428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090002428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090002428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090002428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090002428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090002450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090002469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090002469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090002469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:05.576707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29171): Terminating (SIGTERM) 09:00:05.616570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29196): Terminating (SIGTERM) 09:00:05.656263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29199): Terminating (SIGTERM) 09:00:05.696181 --- ParallelTerminationStrategy: PID 29171 died... 09:00:05.715662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29171): Terminated: ok {rc=0} 09:00:05.759468 --- ParallelTerminationStrategy: PID 29196 died... 09:00:05.778377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29196): Terminated: ok {rc=0} 09:00:05.821834 --- ParallelTerminationStrategy: PID 29199 died... 09:00:05.840538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29199): Terminated: ok {rc=0} 09:00:05.926528 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:00:07.232917 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:07.239302 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:00:07.271525 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:00:07.305987 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:00:07.359569 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:00:07.394537 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:00:07.429959 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:00:07.992025 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:00:07.998590 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.010834 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:00:08.082533 tst switch_tch_pdch.py: using LAC 32875 09:00:08.203673 tst switch_tch_pdch.py: using RAC 235 09:00:08.324722 tst switch_tch_pdch.py: using CellId 32875 09:00:08.445461 tst switch_tch_pdch.py: using BVCI 32876 09:00:08.561112 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.572792 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.584493 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.595880 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.607309 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.619381 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.631056 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:08.642431 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:00:08.757719 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:00:08.876358 tst switch_tch_pdch.py:51: start network... 09:00:09.086609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:09.568922 run create_hlr_db(pid=29206): Launched 09:00:09.695479 bus /gobi_6: Setting Powered False 09:00:10.757355 run create_hlr_db(pid=29206): Terminated: ok {rc=0} 09:00:11.173692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29208): Launched 09:00:11.464010 run osmo-hlr_10.42.42.2(pid=29209): Launched 09:00:11.575892 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:12.114553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29211): Launched 09:00:12.426060 run osmo-stp_10.42.42.5(pid=29212): Launched 09:00:12.545067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:13.085194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29215): Launched 09:00:13.204179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:13.466853 run patchelf(pid=29216): Launched 09:00:13.639950 run osmo-stp_10.42.42.5(pid=29212): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29212)] 09:00:13.772149 run osmo-stp_10.42.42.5(pid=29212): stdout: | (launched: 2022-12-13_09:00:12.369688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:13.906013 run osmo-stp_10.42.42.5(pid=29212): stderr: | 20221213090012559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090012559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090012559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090012560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090012560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090012560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090012560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:14.040712 run osmo-stp_10.42.42.5(pid=29212): stdout: | (launched: 2022-12-13_09:00:12.369688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:14.169291 run osmo-stp_10.42.42.5(pid=29212): stderr: | 20221213090012559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090012559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090012559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090012560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090012560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090012560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090012560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:14.321419 run patchelf(pid=29216): Terminating (SIGINT) 09:00:14.495718 run patchelf(pid=29216): Terminated: ok {rc=0} 09:00:14.621588 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29212): Process ended prematurely: osmo-stp_10.42.42.5(pid=29212) [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29212)] [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:00:14.630943 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:00:14.658523 run osmo-hlr_10.42.42.2(pid=29209): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29209)] 09:00:14.708076 run osmo-hlr_10.42.42.2(pid=29209): stdout: | (launched: 2022-12-13_09:00:11.411224) 09:00:14.759385 run osmo-hlr_10.42.42.2(pid=29209): stderr: | 20221213090011588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090011589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090011589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090011589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090011589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090011589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090011601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090011609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090011609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090011610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:14.810989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29208): Terminating (SIGTERM) 09:00:14.853259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29211): Terminating (SIGTERM) 09:00:14.895505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29215): Terminating (SIGTERM) 09:00:14.938856 --- ParallelTerminationStrategy: PID 29208 died... 09:00:14.959460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29208): Terminated: ok {rc=0} 09:00:15.005408 --- ParallelTerminationStrategy: PID 29211 died... 09:00:15.025217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29211): Terminated: ok {rc=0} 09:00:15.070907 --- ParallelTerminationStrategy: PID 29215 died... 09:00:15.090597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29215): Terminated: ok {rc=0} 09:00:15.177531 bus /gobi_0: Setting Powered False 09:00:16.277734 bus /gobi_0: Setting Powered False 09:00:17.403356 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:00:18.659425 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:18.665712 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:00:18.699294 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:00:18.734854 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:00:18.788245 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:00:18.822173 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:00:18.857330 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:00:19.410183 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:00:19.416241 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:19.429253 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:00:19.501717 tst switch_tch_pdch.py: using LAC 32876 09:00:19.625403 tst switch_tch_pdch.py: using RAC 236 09:00:19.747880 tst switch_tch_pdch.py: using CellId 32876 09:00:19.864299 tst switch_tch_pdch.py: using BVCI 32877 09:00:19.970035 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:19.981111 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:19.991930 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:20.002876 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:20.014189 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:20.025567 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:20.036770 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:20.047909 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:00:20.166186 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:00:20.280879 tst switch_tch_pdch.py:51: start network... 09:00:20.476254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:20.902404 run create_hlr_db(pid=29220): Launched 09:00:21.013397 bus /gobi_6: Setting Powered False 09:00:22.072159 run create_hlr_db(pid=29220): Terminated: ok {rc=0} 09:00:22.453709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29222): Launched 09:00:22.744630 run osmo-hlr_10.42.42.2(pid=29223): Launched 09:00:22.856351 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:23.348850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29225): Launched 09:00:23.639982 run osmo-stp_10.42.42.5(pid=29226): Launched 09:00:23.751700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:24.229885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29228): Launched 09:00:24.342283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:24.587795 run patchelf(pid=29229): Launched 09:00:24.749738 run osmo-stp_10.42.42.5(pid=29226): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29226)] 09:00:24.873732 run osmo-stp_10.42.42.5(pid=29226): stdout: | (launched: 2022-12-13_09:00:23.586853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:24.998974 run osmo-stp_10.42.42.5(pid=29226): stderr: | 20221213090023754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090023754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090023754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090023754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090023757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090023757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090023757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:25.124428 run osmo-stp_10.42.42.5(pid=29226): stdout: | (launched: 2022-12-13_09:00:23.586853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:25.244189 run osmo-stp_10.42.42.5(pid=29226): stderr: | 20221213090023754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090023754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090023754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090023754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090023757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090023757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090023757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:25.387113 run patchelf(pid=29229): Terminating (SIGINT) 09:00:25.550639 run patchelf(pid=29229): Terminated: ok {rc=0} 09:00:25.668743 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29226): Process ended prematurely: osmo-stp_10.42.42.5(pid=29226) [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29226)] [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:00:25.677731 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 09:00:25.703906 run osmo-hlr_10.42.42.2(pid=29223): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29223)] 09:00:25.752364 run osmo-hlr_10.42.42.2(pid=29223): stdout: | (launched: 2022-12-13_09:00:22.691519) 09:00:25.802004 run osmo-hlr_10.42.42.2(pid=29223): stderr: | 20221213090022865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090022865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090022865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090022865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090022865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090022865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090022876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090022885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090022885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090022885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:25.851936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29222): Terminating (SIGTERM) 09:00:25.891690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29225): Terminating (SIGTERM) 09:00:25.931502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29228): Terminating (SIGTERM) 09:00:25.971569 --- ParallelTerminationStrategy: PID 29222 died... 09:00:25.991191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29222): Terminated: ok {rc=0} 09:00:26.035048 --- ParallelTerminationStrategy: PID 29225 died... 09:00:26.053721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29225): Terminated: ok {rc=0} 09:00:26.097465 --- ParallelTerminationStrategy: PID 29228 died... 09:00:26.116329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29228): Terminated: ok {rc=0} 09:00:26.199275 bus /gobi_0: Setting Powered False 09:00:27.294553 bus /gobi_0: Setting Powered False 09:00:28.408454 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 09:00:29.659049 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:29.663145 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 09:00:29.696044 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 09:00:29.704452 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:00:29.759523 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 09:00:29.792676 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 09:00:29.799479 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:00:30.334231 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 09:00:30.339423 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 09:00:30.350530 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:00:30.402964 tst mo_mt_sms.py: using LAC 32877 09:00:30.525381 tst mo_mt_sms.py: using RAC 237 09:00:30.649155 tst mo_mt_sms.py: using CellId 32877 09:00:30.770836 tst mo_mt_sms.py: using BVCI 32878 09:00:30.885241 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:00:31.018457 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:00:31.140113 tst mo_mt_sms.py:9: start nitb and bts... 09:00:31.342868 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:00:31.962807 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29233): Launched 09:00:32.273698 run osmo-nitb_10.42.42.2(pid=29234): Launched 09:00:32.435458 run osmo-nitb_10.42.42.2(pid=29234): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29234)] 09:00:32.567368 run osmo-nitb_10.42.42.2(pid=29234): stdout: | (launched: 2022-12-13_09:00:32.219618) 09:00:32.700880 run osmo-nitb_10.42.42.2(pid=29234): stderr: | (launched: 2022-12-13_09:00:32.264176) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:00:32.834905 run osmo-nitb_10.42.42.2(pid=29234): stdout: | (launched: 2022-12-13_09:00:32.219618) 09:00:32.962493 run osmo-nitb_10.42.42.2(pid=29234): stderr: | (launched: 2022-12-13_09:00:32.264176) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29234): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29234) [trial-2387↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29234)] 09:00:33.383920 tst osmo-nitb_10.42.42.2(pid=29234): stdout: | (launched: 2022-12-13_09:00:32.219618) 09:00:33.502291 tst osmo-nitb_10.42.42.2(pid=29234): stderr: | (launched: 2022-12-13_09:00:32.264176) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:00:33.641502 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29234): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29234) [trial-2387↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29234)] [trial-2387↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 09:00:33.649803 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 09:00:33.656264 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29233): Terminating (SIGTERM) 09:00:33.865246 --- ParallelTerminationStrategy: PID 29233 died... 09:00:33.885581 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29233): Terminated: ok {rc=0} 09:00:33.971522 bus /sierra_3: Setting Powered False 09:00:35.071105 bus /sierra_3: Setting Powered False 09:00:36.184770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:trx-sysmocell5000 --------------------------------------------------------------------- 09:00:37.385425 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:37.389875 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 09:00:37.424004 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:00:37.451768 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:00:37.504044 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 09:00:37.538361 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:00:37.565643 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:00:38.114680 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 09:00:38.120205 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:38.131751 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:00:38.180884 tst mo_mt_sms.py: using LAC 32878 09:00:38.303911 tst mo_mt_sms.py: using RAC 238 09:00:38.427033 tst mo_mt_sms.py: using CellId 32878 09:00:38.554853 tst mo_mt_sms.py: using BVCI 32879 09:00:38.670348 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:38.681669 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:38.692849 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:38.703979 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:38.715385 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:38.726750 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:00:38.842161 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:00:38.958353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:39.444496 run create_hlr_db(pid=29238): Launched 09:00:39.571497 bus /sierra_2: Setting Powered False 09:00:40.633937 run create_hlr_db(pid=29238): Terminated: ok {rc=0} 09:00:41.052598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29240): Launched 09:00:41.343005 run osmo-hlr_10.42.42.2(pid=29241): Launched 09:00:41.455100 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:41.962784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29243): Launched 09:00:42.253234 run osmo-stp_10.42.42.5(pid=29244): Launched 09:00:42.365067 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:42.893964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29246): Launched 09:00:43.185238 run osmo-msc_10.42.42.6(pid=29247): Launched 09:00:43.348709 run osmo-stp_10.42.42.5(pid=29244): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29244)] 09:00:43.473477 run osmo-stp_10.42.42.5(pid=29244): stdout: | (launched: 2022-12-13_09:00:42.199770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:43.597947 run osmo-stp_10.42.42.5(pid=29244): stderr: | 20221213090042367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090042367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090042368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090042368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090042370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090042370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090042370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:43.719853 run osmo-stp_10.42.42.5(pid=29244): stdout: | (launched: 2022-12-13_09:00:42.199770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:43.836785 run osmo-stp_10.42.42.5(pid=29244): stderr: | 20221213090042367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090042367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090042368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090042368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090042370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090042370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090042370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:43.976400 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29244): Process ended prematurely: osmo-stp_10.42.42.5(pid=29244) [trial-2387↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29244)] [trial-2387↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 09:00:43.984598 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 09:00:44.010466 run osmo-hlr_10.42.42.2(pid=29241): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29241)] 09:00:44.058121 run osmo-hlr_10.42.42.2(pid=29241): stdout: | (launched: 2022-12-13_09:00:41.290014) 09:00:44.107186 run osmo-hlr_10.42.42.2(pid=29241): stderr: | 20221213090041463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090041463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090041463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090041463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090041463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090041463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090041479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090041488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090041488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090041488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:44.175921 run osmo-msc_10.42.42.6(pid=29247): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29247)] 09:00:44.222969 run osmo-msc_10.42.42.6(pid=29247): stdout: | (launched: 2022-12-13_09:00:43.132240) 09:00:44.272597 run osmo-msc_10.42.42.6(pid=29247): stderr: | 20221213090043402 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090043402 DLGLOBAL DEBUG validating counter group 0x7f8400461c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090043402 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090043402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090043402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090043403 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090043404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090043405 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090043405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090043405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:00:44.321961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29240): Terminating (SIGTERM) 09:00:44.361387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29243): Terminating (SIGTERM) 09:00:44.400796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29246): Terminating (SIGTERM) 09:00:44.440455 --- ParallelTerminationStrategy: PID 29240 died... 09:00:44.459693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29240): Terminated: ok {rc=0} 09:00:44.503335 --- ParallelTerminationStrategy: PID 29243 died... 09:00:44.521962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29243): Terminated: ok {rc=0} 09:00:44.565369 --- ParallelTerminationStrategy: PID 29246 died... 09:00:44.584024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29246): Terminated: ok {rc=0} 09:00:44.669045 bus /sierra_3: Setting Powered False 09:00:45.765921 bus /sierra_3: Setting Powered False 09:00:46.890014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 09:00:48.124623 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:48.128435 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 09:00:48.161341 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 09:00:48.169540 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 09:00:48.205086 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 09:00:48.238925 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 09:00:48.245774 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 09:00:48.764302 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 09:00:48.769538 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 09:00:48.780499 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:00:48.828568 tst assert_extension.py: using LAC 32879 09:00:48.943578 tst assert_extension.py: using RAC 239 09:00:49.058046 tst assert_extension.py: using CellId 32879 09:00:49.172054 tst assert_extension.py: using BVCI 32880 09:00:49.278540 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 09:00:49.396478 tst assert_extension.py:10: start nitb and bts... 09:00:49.606306 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:00:50.243414 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29252): Launched 09:00:50.554617 run osmo-nitb_10.42.42.2(pid=29253): Launched 09:00:50.727376 run osmo-nitb_10.42.42.2(pid=29253): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29253)] 09:00:50.867369 run osmo-nitb_10.42.42.2(pid=29253): stdout: | (launched: 2022-12-13_09:00:50.498235) 09:00:51.010324 run osmo-nitb_10.42.42.2(pid=29253): stderr: | (launched: 2022-12-13_09:00:50.544787) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:00:51.152156 run osmo-nitb_10.42.42.2(pid=29253): stdout: | (launched: 2022-12-13_09:00:50.498235) 09:00:51.288796 run osmo-nitb_10.42.42.2(pid=29253): stderr: | (launched: 2022-12-13_09:00:50.544787) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29253): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29253) [trial-2387↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29253)] 09:00:51.671841 tst osmo-nitb_10.42.42.2(pid=29253): stdout: | (launched: 2022-12-13_09:00:50.498235) 09:00:51.799681 tst osmo-nitb_10.42.42.2(pid=29253): stderr: | (launched: 2022-12-13_09:00:50.544787) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:00:51.950944 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29253): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29253) [trial-2387↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29253)] [trial-2387↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 09:00:51.959959 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:00:51.967587 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29252): Terminating (SIGTERM) 09:00:52.177662 --- ParallelTerminationStrategy: PID 29252 died... 09:00:52.198887 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29252): Terminated: ok {rc=0} 09:00:52.286656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 09:00:53.469819 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:53.473936 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 09:00:53.509377 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:00:53.535806 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 09:00:53.568565 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 09:00:53.601848 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:00:53.628295 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 09:00:54.165847 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 09:00:54.172023 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:54.183433 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:00:54.233753 tst assert_extension.py: using LAC 32880 09:00:54.361079 tst assert_extension.py: using RAC 240 09:00:54.484076 tst assert_extension.py: using CellId 32880 09:00:54.605940 tst assert_extension.py: using BVCI 32881 09:00:54.719449 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:54.730878 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:54.742141 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:54.753311 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:54.764348 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:00:54.775538 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 09:00:54.893435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:55.377166 run create_hlr_db(pid=29259): Launched 09:00:55.504709 bus /sierra_2: Setting Powered False 09:00:56.566287 run create_hlr_db(pid=29259): Terminated: ok {rc=0} 09:00:57.000744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29261): Launched 09:00:57.311664 run osmo-hlr_10.42.42.2(pid=29262): Launched 09:00:57.430550 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:58.056302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29264): Launched 09:00:58.362342 run osmo-stp_10.42.42.5(pid=29265): Launched 09:00:58.479199 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:59.033662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29267): Launched 09:00:59.339168 run osmo-msc_10.42.42.6(pid=29268): Launched 09:00:59.510065 run osmo-stp_10.42.42.5(pid=29265): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29265)] 09:00:59.640899 run osmo-stp_10.42.42.5(pid=29265): stdout: | (launched: 2022-12-13_09:00:58.306723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:59.771537 run osmo-stp_10.42.42.5(pid=29265): stderr: | 20221213090058495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090058496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090058496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090058496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090058497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090058497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090058497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:59.901436 run osmo-stp_10.42.42.5(pid=29265): stdout: | (launched: 2022-12-13_09:00:58.306723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:00.024894 run osmo-stp_10.42.42.5(pid=29265): stderr: | 20221213090058495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090058496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090058496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090058496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090058497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090058497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090058497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:00.172025 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29265): Process ended prematurely: osmo-stp_10.42.42.5(pid=29265) [trial-2387↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29265)] [trial-2387↪ussd:trx-sysmocell5000↪assert_extension.py:17] 09:01:00.180936 tst assert_extension.py:17: Test FAILED (6.0 sec) 09:01:00.208227 run osmo-hlr_10.42.42.2(pid=29262): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29262)] 09:01:00.258011 run osmo-hlr_10.42.42.2(pid=29262): stdout: | (launched: 2022-12-13_09:00:57.255326) 09:01:00.309261 run osmo-hlr_10.42.42.2(pid=29262): stderr: | 20221213090057453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090057453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090057453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090057453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090057453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090057454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090057466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090057475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090057475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090057475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:00.380257 run osmo-msc_10.42.42.6(pid=29268): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29268)] 09:01:00.429572 run osmo-msc_10.42.42.6(pid=29268): stdout: | (launched: 2022-12-13_09:00:59.283646) 09:01:00.480500 run osmo-msc_10.42.42.6(pid=29268): stderr: | 20221213090059607 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090059607 DLGLOBAL DEBUG validating counter group 0x7fd058fb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090059607 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090059607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090059607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090059608 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090059609 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090059610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090059610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090059610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:00.532096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29261): Terminating (SIGTERM) 09:01:00.573165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29264): Terminating (SIGTERM) 09:01:00.614711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29267): Terminating (SIGTERM) 09:01:00.657042 --- ParallelTerminationStrategy: PID 29261 died... 09:01:00.677021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29261): Terminated: ok {rc=0} 09:01:00.723260 --- ParallelTerminationStrategy: PID 29264 died... 09:01:00.742640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29264): Terminated: ok {rc=0} 09:01:00.788127 --- ParallelTerminationStrategy: PID 29267 died... 09:01:00.807508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29267): Terminated: ok {rc=0} 09:01:00.900770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:01:02.159559 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:02.169213 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:01:02.211263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:01:02.238997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:01:02.291375 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:01:02.326012 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:01:02.352657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:01:02.902782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:01:02.951259 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:02.962636 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:01:03.032196 tst mo_mt_call.py: using LAC 32881 09:01:03.147422 tst mo_mt_call.py: using RAC 241 09:01:03.266043 tst mo_mt_call.py: using CellId 32881 09:01:03.381328 tst mo_mt_call.py: using BVCI 32882 09:01:03.487645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:03.498916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:03.509831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:03.520620 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:03.532120 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:03.543756 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:03.662964 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:03.780116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:04.265024 run create_hlr_db(pid=29273): Launched 09:01:04.392778 bus /sierra_2: Setting Powered False 09:01:05.455123 run create_hlr_db(pid=29273): Terminated: ok {rc=0} 09:01:05.874359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29275): Launched 09:01:06.166622 run osmo-hlr_10.42.42.2(pid=29276): Launched 09:01:06.279459 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:06.796470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29278): Launched 09:01:07.088626 run osmo-stp_10.42.42.5(pid=29279): Launched 09:01:07.200737 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:07.731873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29281): Launched 09:01:08.025375 run osmo-msc_10.42.42.6(pid=29282): Launched 09:01:08.189737 run osmo-stp_10.42.42.5(pid=29279): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29279)] 09:01:08.315111 run osmo-stp_10.42.42.5(pid=29279): stdout: | (launched: 2022-12-13_09:01:07.035602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:08.440574 run osmo-stp_10.42.42.5(pid=29279): stderr: | 20221213090107205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090107205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090107205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090107206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090107206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090107206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090107206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:08.563362 run osmo-stp_10.42.42.5(pid=29279): stdout: | (launched: 2022-12-13_09:01:07.035602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:08.681221 run osmo-stp_10.42.42.5(pid=29279): stderr: | 20221213090107205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090107205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090107205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090107206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090107206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090107206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090107206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:08.821641 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29279): Process ended prematurely: osmo-stp_10.42.42.5(pid=29279) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29279)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:01:08.830661 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:01:08.856553 run osmo-hlr_10.42.42.2(pid=29276): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29276)] 09:01:08.905258 run osmo-hlr_10.42.42.2(pid=29276): stdout: | (launched: 2022-12-13_09:01:06.113884) 09:01:08.955063 run osmo-hlr_10.42.42.2(pid=29276): stderr: | 20221213090106288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090106288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090106288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090106288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090106288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090106288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090106300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090106311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090106311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090106311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:09.024498 run osmo-msc_10.42.42.6(pid=29282): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29282)] 09:01:09.071853 run osmo-msc_10.42.42.6(pid=29282): stdout: | (launched: 2022-12-13_09:01:07.971562) 09:01:09.121590 run osmo-msc_10.42.42.6(pid=29282): stderr: | 20221213090108242 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090108243 DLGLOBAL DEBUG validating counter group 0x7f8811036c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090108243 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090108243 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090108243 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090108243 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090108245 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090108245 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090108246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090108246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:09.171357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29275): Terminating (SIGTERM) 09:01:09.211301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29278): Terminating (SIGTERM) 09:01:09.251294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29281): Terminating (SIGTERM) 09:01:09.291634 --- ParallelTerminationStrategy: PID 29275 died... 09:01:09.311040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29275): Terminated: ok {rc=0} 09:01:09.355143 --- ParallelTerminationStrategy: PID 29278 died... 09:01:09.374106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29278): Terminated: ok {rc=0} 09:01:09.417888 --- ParallelTerminationStrategy: PID 29281 died... 09:01:09.436799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29281): Terminated: ok {rc=0} 09:01:09.522426 bus /sierra_3: Setting Powered False 09:01:10.620596 bus /sierra_3: Setting Powered False 09:01:11.735511 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:01:12.876188 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:12.888066 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:01:12.958574 tst mo_mt_call_osmux.py: using LAC 32882 09:01:13.074183 tst mo_mt_call_osmux.py: using RAC 242 09:01:13.189365 tst mo_mt_call_osmux.py: using CellId 32882 09:01:13.305338 tst mo_mt_call_osmux.py: using BVCI 32883 09:01:13.420216 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:13.432096 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:13.443761 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:13.455385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:13.467145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:13.478740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:13.595904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:13.712156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:14.166485 run create_hlr_db(pid=29284): Launched 09:01:14.280163 bus /sierra_2: Setting Powered False 09:01:15.339859 run create_hlr_db(pid=29284): Terminated: ok {rc=0} 09:01:15.771015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29286): Launched 09:01:16.148494 run osmo-hlr_10.42.42.2(pid=29287): Launched 09:01:16.303031 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:17.020368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29289): Launched 09:01:17.329013 run osmo-stp_10.42.42.5(pid=29290): Launched 09:01:17.444124 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:17.976754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29292): Launched 09:01:18.270467 run osmo-msc_10.42.42.6(pid=29293): Launched 09:01:18.433508 run osmo-stp_10.42.42.5(pid=29290): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29290)] 09:01:18.558566 run osmo-stp_10.42.42.5(pid=29290): stdout: | (launched: 2022-12-13_09:01:17.275148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:18.683567 run osmo-stp_10.42.42.5(pid=29290): stderr: | 20221213090117441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090117441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090117442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090117442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090117443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090117443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090117443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:18.806592 run osmo-stp_10.42.42.5(pid=29290): stdout: | (launched: 2022-12-13_09:01:17.275148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:18.923774 run osmo-stp_10.42.42.5(pid=29290): stderr: | 20221213090117441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090117441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090117442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090117442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090117443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090117443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090117443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:19.064413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29290): Process ended prematurely: osmo-stp_10.42.42.5(pid=29290) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29290)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:01:19.073516 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:01:19.099424 run osmo-hlr_10.42.42.2(pid=29287): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29287)] 09:01:19.148046 run osmo-hlr_10.42.42.2(pid=29287): stdout: | (launched: 2022-12-13_09:01:16.082631) 09:01:19.197453 run osmo-hlr_10.42.42.2(pid=29287): stderr: | 20221213090116432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090116432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090116432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090116432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090116432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090116432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090116455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090116464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090116477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090116477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:19.266874 run osmo-msc_10.42.42.6(pid=29293): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29293)] 09:01:19.313918 run osmo-msc_10.42.42.6(pid=29293): stdout: | (launched: 2022-12-13_09:01:18.217185) 09:01:19.363193 run osmo-msc_10.42.42.6(pid=29293): stderr: | 20221213090118488 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090118488 DLGLOBAL DEBUG validating counter group 0x7f5596966c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090118488 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090118488 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090118488 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090118489 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090118490 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090118491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090118491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090118491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:19.412784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29286): Terminating (SIGTERM) 09:01:19.452511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29289): Terminating (SIGTERM) 09:01:19.492316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29292): Terminating (SIGTERM) 09:01:19.532411 --- ParallelTerminationStrategy: PID 29286 died... 09:01:19.552087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29286): Terminated: ok {rc=0} 09:01:19.596117 --- ParallelTerminationStrategy: PID 29289 died... 09:01:19.615054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29289): Terminated: ok {rc=0} 09:01:19.658968 --- ParallelTerminationStrategy: PID 29292 died... 09:01:19.677980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29292): Terminated: ok {rc=0} 09:01:19.763860 bus /sierra_3: Setting Powered False 09:01:20.862472 bus /sierra_3: Setting Powered False 09:01:21.976331 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:01:23.224825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:23.231433 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:01:23.264276 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:01:23.291545 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:01:23.342609 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:01:23.375626 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:01:23.402310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:01:23.954068 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:01:24.002146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:24.013480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:01:24.082650 tst mo_mt_call.py: using LAC 32883 09:01:24.201112 tst mo_mt_call.py: using RAC 243 09:01:24.325480 tst mo_mt_call.py: using CellId 32883 09:01:24.449703 tst mo_mt_call.py: using BVCI 32884 09:01:24.565344 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:24.577151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:24.589243 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:24.600683 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:24.612696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:24.624653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:01:24.739914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:01:24.858386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:25.313496 run create_hlr_db(pid=29298): Launched 09:01:25.444222 bus /sierra_2: Setting Powered False 09:01:26.506889 run create_hlr_db(pid=29298): Terminated: ok {rc=0} 09:01:26.926128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Launched 09:01:27.220063 run osmo-hlr_10.42.42.2(pid=29301): Launched 09:01:27.332132 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:27.854730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Launched 09:01:28.148383 run osmo-stp_10.42.42.5(pid=29304): Launched 09:01:28.260552 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:28.797350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29306): Launched 09:01:29.092180 run osmo-msc_10.42.42.6(pid=29307): Launched 09:01:29.257944 run osmo-stp_10.42.42.5(pid=29304): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] 09:01:29.384886 run osmo-stp_10.42.42.5(pid=29304): stdout: | (launched: 2022-12-13_09:01:28.094916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:29.510645 run osmo-stp_10.42.42.5(pid=29304): stderr: | 20221213090128264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090128264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090128264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090128265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090128267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090128267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090128267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:29.633860 run osmo-stp_10.42.42.5(pid=29304): stdout: | (launched: 2022-12-13_09:01:28.094916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:29.752071 run osmo-stp_10.42.42.5(pid=29304): stderr: | 20221213090128264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090128264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090128264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090128265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090128267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090128267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090128267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:29.894529 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29304): Process ended prematurely: osmo-stp_10.42.42.5(pid=29304) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:01:29.903589 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:01:29.929819 run osmo-hlr_10.42.42.2(pid=29301): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29301)] 09:01:29.978172 run osmo-hlr_10.42.42.2(pid=29301): stdout: | (launched: 2022-12-13_09:01:27.166760) 09:01:30.027674 run osmo-hlr_10.42.42.2(pid=29301): stderr: | 20221213090127341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090127341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090127341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090127341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090127341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090127341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090127354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090127363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090127363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090127363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:30.097109 run osmo-msc_10.42.42.6(pid=29307): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29307)] 09:01:30.144486 run osmo-msc_10.42.42.6(pid=29307): stdout: | (launched: 2022-12-13_09:01:29.038518) 09:01:30.194032 run osmo-msc_10.42.42.6(pid=29307): stderr: | 20221213090129308 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090129308 DLGLOBAL DEBUG validating counter group 0x7fa08988bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090129308 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090129308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090129308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090129309 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090129312 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090129313 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090129313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090129313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:30.244134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Terminating (SIGTERM) 09:01:30.283723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Terminating (SIGTERM) 09:01:30.323457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29306): Terminating (SIGTERM) 09:01:30.363434 --- ParallelTerminationStrategy: PID 29300 died... 09:01:30.382909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Terminated: ok {rc=0} 09:01:30.426863 --- ParallelTerminationStrategy: PID 29303 died... 09:01:30.445923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Terminated: ok {rc=0} 09:01:30.489815 --- ParallelTerminationStrategy: PID 29306 died... 09:01:30.508831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29306): Terminated: ok {rc=0} 09:01:30.594556 bus /sierra_3: Setting Powered False 09:01:31.702239 bus /sierra_3: Setting Powered False 09:01:32.834167 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:01:33.978079 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:33.989801 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:01:34.059861 tst mo_mt_call_osmux.py: using LAC 32884 09:01:34.176840 tst mo_mt_call_osmux.py: using RAC 244 09:01:34.292619 tst mo_mt_call_osmux.py: using CellId 32884 09:01:34.407288 tst mo_mt_call_osmux.py: using BVCI 32885 09:01:34.513740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:34.524938 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:34.535875 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:34.547375 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:34.558673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:34.570004 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:01:34.684368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:01:34.801749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:35.255362 run create_hlr_db(pid=29309): Launched 09:01:35.366572 bus /sierra_2: Setting Powered False 09:01:36.425470 run create_hlr_db(pid=29309): Terminated: ok {rc=0} 09:01:36.834655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Launched 09:01:37.126898 run osmo-hlr_10.42.42.2(pid=29312): Launched 09:01:37.238825 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:37.755801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Launched 09:01:38.050231 run osmo-stp_10.42.42.5(pid=29315): Launched 09:01:38.162936 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:38.693185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29317): Launched 09:01:38.986790 run osmo-msc_10.42.42.6(pid=29318): Launched 09:01:39.152428 run osmo-stp_10.42.42.5(pid=29315): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] 09:01:39.277850 run osmo-stp_10.42.42.5(pid=29315): stdout: | (launched: 2022-12-13_09:01:37.997190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:39.403989 run osmo-stp_10.42.42.5(pid=29315): stderr: | 20221213090138165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090138166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090138167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090138167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090138168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090138168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090138168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:39.527299 run osmo-stp_10.42.42.5(pid=29315): stdout: | (launched: 2022-12-13_09:01:37.997190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:39.646035 run osmo-stp_10.42.42.5(pid=29315): stderr: | 20221213090138165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090138166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090138167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090138167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090138168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090138168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090138168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:39.787526 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29315): Process ended prematurely: osmo-stp_10.42.42.5(pid=29315) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:01:39.796411 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 09:01:39.822175 run osmo-hlr_10.42.42.2(pid=29312): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29312)] 09:01:39.871200 run osmo-hlr_10.42.42.2(pid=29312): stdout: | (launched: 2022-12-13_09:01:37.073715) 09:01:39.920704 run osmo-hlr_10.42.42.2(pid=29312): stderr: | 20221213090137247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090137247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090137247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090137247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090137247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090137247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090137259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090137268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090137268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090137268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:39.990702 run osmo-msc_10.42.42.6(pid=29318): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29318)] 09:01:40.037487 run osmo-msc_10.42.42.6(pid=29318): stdout: | (launched: 2022-12-13_09:01:38.933719) 09:01:40.086691 run osmo-msc_10.42.42.6(pid=29318): stderr: | 20221213090139206 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090139206 DLGLOBAL DEBUG validating counter group 0x7f3743c4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090139206 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090139206 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090139206 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090139206 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090139208 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090139208 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090139208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090139209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:40.135730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Terminating (SIGTERM) 09:01:40.175127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Terminating (SIGTERM) 09:01:40.214542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29317): Terminating (SIGTERM) 09:01:40.254018 --- ParallelTerminationStrategy: PID 29311 died... 09:01:40.273107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29311): Terminated: ok {rc=0} 09:01:40.316517 --- ParallelTerminationStrategy: PID 29314 died... 09:01:40.335099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29314): Terminated: ok {rc=0} 09:01:40.378979 --- ParallelTerminationStrategy: PID 29317 died... 09:01:40.397535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29317): Terminated: ok {rc=0} 09:01:40.480113 bus /sierra_3: Setting Powered False 09:01:41.577141 bus /sierra_3: Setting Powered False 09:01:42.692017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:01:43.946764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:43.953847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:01:43.988543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:01:44.017723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:01:44.069955 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:01:44.104378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:01:44.132395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:01:44.685867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:01:44.737285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:44.749360 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:01:44.821723 tst mo_mt_call.py: using LAC 32885 09:01:44.948621 tst mo_mt_call.py: using RAC 245 09:01:45.074477 tst mo_mt_call.py: using CellId 32885 09:01:45.197459 tst mo_mt_call.py: using BVCI 32886 09:01:45.307046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:45.318476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:45.329747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:45.340696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:45.352206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:45.363706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:01:45.478703 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:01:45.596691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:46.104860 run create_hlr_db(pid=29323): Launched 09:01:46.258107 bus /sierra_2: Setting Powered False 09:01:47.328496 run create_hlr_db(pid=29323): Terminated: ok {rc=0} 09:01:47.759696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29325): Launched 09:01:48.075298 run osmo-hlr_10.42.42.2(pid=29326): Launched 09:01:48.195527 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:48.737416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29328): Launched 09:01:49.051329 run osmo-stp_10.42.42.5(pid=29329): Launched 09:01:49.170648 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:49.739471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29331): Launched 09:01:50.054963 run osmo-msc_10.42.42.6(pid=29332): Launched 09:01:50.231386 run osmo-stp_10.42.42.5(pid=29329): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29329)] 09:01:50.365344 run osmo-stp_10.42.42.5(pid=29329): stdout: | (launched: 2022-12-13_09:01:48.994809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:50.499288 run osmo-stp_10.42.42.5(pid=29329): stderr: | 20221213090149188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090149188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090149188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090149189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090149189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090149189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090149189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:50.632644 run osmo-stp_10.42.42.5(pid=29329): stdout: | (launched: 2022-12-13_09:01:48.994809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:50.758739 run osmo-stp_10.42.42.5(pid=29329): stderr: | 20221213090149188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090149188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090149188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090149189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090149189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090149189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090149189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:50.909467 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29329): Process ended prematurely: osmo-stp_10.42.42.5(pid=29329) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29329)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:01:50.919062 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:01:50.946648 run osmo-hlr_10.42.42.2(pid=29326): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29326)] 09:01:50.996644 run osmo-hlr_10.42.42.2(pid=29326): stdout: | (launched: 2022-12-13_09:01:48.018618) 09:01:51.048360 run osmo-hlr_10.42.42.2(pid=29326): stderr: | 20221213090148216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090148217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090148217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090148217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090148217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090148217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090148228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090148236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090148236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090148236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:51.119786 run osmo-msc_10.42.42.6(pid=29332): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29332)] 09:01:51.169291 run osmo-msc_10.42.42.6(pid=29332): stdout: | (launched: 2022-12-13_09:01:49.998040) 09:01:51.220451 run osmo-msc_10.42.42.6(pid=29332): stderr: | 20221213090150317 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090150317 DLGLOBAL DEBUG validating counter group 0x7f664f99ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090150317 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090150317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090150317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090150317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090150319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090150319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090150319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090150320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:51.271756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29325): Terminating (SIGTERM) 09:01:51.312817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29328): Terminating (SIGTERM) 09:01:51.354245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29331): Terminating (SIGTERM) 09:01:51.395556 --- ParallelTerminationStrategy: PID 29325 died... 09:01:51.415346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29325): Terminated: ok {rc=0} 09:01:51.461069 --- ParallelTerminationStrategy: PID 29328 died... 09:01:51.480362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29328): Terminated: ok {rc=0} 09:01:51.525884 --- ParallelTerminationStrategy: PID 29331 died... 09:01:51.545297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29331): Terminated: ok {rc=0} 09:01:51.631619 bus /sierra_3: Setting Powered False 09:01:52.729945 bus /sierra_3: Setting Powered False 09:01:53.844664 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:01:54.991762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:55.003907 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:01:55.075500 tst mo_mt_call_osmux.py: using LAC 32886 09:01:55.198723 tst mo_mt_call_osmux.py: using RAC 246 09:01:55.322247 tst mo_mt_call_osmux.py: using CellId 32886 09:01:55.445079 tst mo_mt_call_osmux.py: using BVCI 32887 09:01:55.561211 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:55.572832 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:55.584329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:55.595839 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:55.607461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:01:55.618898 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:01:55.734787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:01:55.850398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:56.308400 run create_hlr_db(pid=29334): Launched 09:01:56.422094 bus /sierra_2: Setting Powered False 09:01:57.482476 run create_hlr_db(pid=29334): Terminated: ok {rc=0} 09:01:57.894359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29336): Launched 09:01:58.189078 run osmo-hlr_10.42.42.2(pid=29337): Launched 09:01:58.301811 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:58.823417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29339): Launched 09:01:59.117572 run osmo-stp_10.42.42.5(pid=29340): Launched 09:01:59.230134 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:59.763061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29342): Launched 09:02:00.058555 run osmo-msc_10.42.42.6(pid=29343): Launched 09:02:00.224141 run osmo-stp_10.42.42.5(pid=29340): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29340)] 09:02:00.351077 run osmo-stp_10.42.42.5(pid=29340): stdout: | (launched: 2022-12-13_09:01:59.064064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:00.476929 run osmo-stp_10.42.42.5(pid=29340): stderr: | 20221213090159235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090159235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090159235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090159235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090159236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090159236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090159236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:00.600899 run osmo-stp_10.42.42.5(pid=29340): stdout: | (launched: 2022-12-13_09:01:59.064064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:00.719241 run osmo-stp_10.42.42.5(pid=29340): stderr: | 20221213090159235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090159235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090159235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090159235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090159236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090159236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090159236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:00.860848 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29340): Process ended prematurely: osmo-stp_10.42.42.5(pid=29340) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29340)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:02:00.869965 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 09:02:00.896361 run osmo-hlr_10.42.42.2(pid=29337): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29337)] 09:02:00.946192 run osmo-hlr_10.42.42.2(pid=29337): stdout: | (launched: 2022-12-13_09:01:58.135820) 09:02:01.003986 run osmo-hlr_10.42.42.2(pid=29337): stderr: | 20221213090158309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090158309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090158309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090158309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090158309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090158309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090158320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090158328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090158329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090158329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:01.075193 run osmo-msc_10.42.42.6(pid=29343): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29343)] 09:02:01.124317 run osmo-msc_10.42.42.6(pid=29343): stdout: | (launched: 2022-12-13_09:02:00.004487) 09:02:01.175543 run osmo-msc_10.42.42.6(pid=29343): stderr: | 20221213090200273 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090200273 DLGLOBAL DEBUG validating counter group 0x7fcdc07e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090200273 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090200273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090200273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090200273 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090200275 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090200275 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090200276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090200276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:01.227579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29336): Terminating (SIGTERM) 09:02:01.269384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29339): Terminating (SIGTERM) 09:02:01.310934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29342): Terminating (SIGTERM) 09:02:01.352579 --- ParallelTerminationStrategy: PID 29336 died... 09:02:01.373609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29336): Terminated: ok {rc=0} 09:02:01.419618 --- ParallelTerminationStrategy: PID 29339 died... 09:02:01.440364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29339): Terminated: ok {rc=0} 09:02:01.486362 --- ParallelTerminationStrategy: PID 29342 died... 09:02:01.507026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29342): Terminated: ok {rc=0} 09:02:01.595602 bus /sierra_3: Setting Powered False 09:02:02.692871 bus /sierra_3: Setting Powered False 09:02:03.809850 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:02:05.059016 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:05.065567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:02:05.098590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:02:05.126111 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:02:05.175795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:02:05.209125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:02:05.236143 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:02:05.796010 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:02:05.846596 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:05.858370 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:02:05.927754 tst mo_mt_call.py: using LAC 32887 09:02:06.053842 tst mo_mt_call.py: using RAC 247 09:02:06.176918 tst mo_mt_call.py: using CellId 32887 09:02:06.298565 tst mo_mt_call.py: using BVCI 32888 09:02:06.414499 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:06.426087 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:06.437463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:06.448627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:06.460137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:06.471502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:06.589655 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:06.706377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:07.160135 run create_hlr_db(pid=29348): Launched 09:02:07.272443 bus /sierra_2: Setting Powered False 09:02:08.332060 run create_hlr_db(pid=29348): Terminated: ok {rc=0} 09:02:08.760795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29350): Launched 09:02:09.074933 run osmo-hlr_10.42.42.2(pid=29351): Launched 09:02:09.194561 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:09.735178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29353): Launched 09:02:10.048786 run osmo-stp_10.42.42.5(pid=29354): Launched 09:02:10.169123 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:10.737189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29356): Launched 09:02:11.051255 run osmo-msc_10.42.42.6(pid=29357): Launched 09:02:11.226539 run osmo-stp_10.42.42.5(pid=29354): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29354)] 09:02:11.359861 run osmo-stp_10.42.42.5(pid=29354): stdout: | (launched: 2022-12-13_09:02:09.992067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:11.493459 run osmo-stp_10.42.42.5(pid=29354): stderr: | 20221213090210182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090210182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090210183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090210183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090210185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090210186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090210186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:11.626445 run osmo-stp_10.42.42.5(pid=29354): stdout: | (launched: 2022-12-13_09:02:09.992067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:11.752132 run osmo-stp_10.42.42.5(pid=29354): stderr: | 20221213090210182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090210182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090210183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090210183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090210185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090210186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090210186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:11.902688 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29354): Process ended prematurely: osmo-stp_10.42.42.5(pid=29354) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29354)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:02:11.912244 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:02:11.939703 run osmo-hlr_10.42.42.2(pid=29351): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29351)] 09:02:11.989893 run osmo-hlr_10.42.42.2(pid=29351): stdout: | (launched: 2022-12-13_09:02:09.018345) 09:02:12.041476 run osmo-hlr_10.42.42.2(pid=29351): stderr: | 20221213090209216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090209216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090209216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090209216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090209216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090209216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090209229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090209237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090209238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090209238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:12.113762 run osmo-msc_10.42.42.6(pid=29357): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29357)] 09:02:12.163367 run osmo-msc_10.42.42.6(pid=29357): stdout: | (launched: 2022-12-13_09:02:10.994515) 09:02:12.214094 run osmo-msc_10.42.42.6(pid=29357): stderr: | 20221213090211313 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090211314 DLGLOBAL DEBUG validating counter group 0x7f42d0a87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090211314 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090211314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090211314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090211314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090211317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090211318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090211318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090211318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:12.265251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29350): Terminating (SIGTERM) 09:02:12.306121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29353): Terminating (SIGTERM) 09:02:12.347393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29356): Terminating (SIGTERM) 09:02:12.388771 --- ParallelTerminationStrategy: PID 29350 died... 09:02:12.408687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29350): Terminated: ok {rc=0} 09:02:12.454590 --- ParallelTerminationStrategy: PID 29353 died... 09:02:12.474220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29353): Terminated: ok {rc=0} 09:02:12.519797 --- ParallelTerminationStrategy: PID 29356 died... 09:02:12.539328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29356): Terminated: ok {rc=0} 09:02:12.626261 bus /sierra_3: Setting Powered False 09:02:13.722174 bus /sierra_3: Setting Powered False 09:02:14.836295 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:02:16.013671 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:16.026340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:02:16.109438 tst mo_mt_call_osmux.py: using LAC 32888 09:02:16.264346 tst mo_mt_call_osmux.py: using RAC 248 09:02:16.422143 tst mo_mt_call_osmux.py: using CellId 32888 09:02:16.548924 tst mo_mt_call_osmux.py: using BVCI 32889 09:02:16.687555 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:16.699958 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:16.711993 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:16.724099 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:16.736768 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:16.749480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:16.899463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:17.022412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:17.524466 run create_hlr_db(pid=29359): Launched 09:02:17.637142 bus /sierra_2: Setting Powered False 09:02:18.696716 run create_hlr_db(pid=29359): Terminated: ok {rc=0} 09:02:19.108181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Launched 09:02:19.402009 run osmo-hlr_10.42.42.2(pid=29362): Launched 09:02:19.514068 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:20.037121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Launched 09:02:20.331336 run osmo-stp_10.42.42.5(pid=29365): Launched 09:02:20.443845 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:20.977221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Launched 09:02:21.271828 run osmo-msc_10.42.42.6(pid=29368): Launched 09:02:21.437913 run osmo-stp_10.42.42.5(pid=29365): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] 09:02:21.564307 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-13_09:02:20.277960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:21.689915 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221213090220448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090220449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090220449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090220449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090220450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090220450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090220450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:21.813279 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-13_09:02:20.277960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:21.931334 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221213090220448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090220449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090220449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090220449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090220450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090220450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090220450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:22.072569 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29365): Process ended prematurely: osmo-stp_10.42.42.5(pid=29365) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:02:22.081721 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:02:22.107667 run osmo-hlr_10.42.42.2(pid=29362): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29362)] 09:02:22.155165 run osmo-hlr_10.42.42.2(pid=29362): stdout: | (launched: 2022-12-13_09:02:19.348413) 09:02:22.204365 run osmo-hlr_10.42.42.2(pid=29362): stderr: | 20221213090219523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090219523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090219523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090219523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090219523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090219523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090219536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090219545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090219545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090219545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:22.272658 run osmo-msc_10.42.42.6(pid=29368): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29368)] 09:02:22.319343 run osmo-msc_10.42.42.6(pid=29368): stdout: | (launched: 2022-12-13_09:02:21.218222) 09:02:22.368174 run osmo-msc_10.42.42.6(pid=29368): stderr: | 20221213090221486 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090221486 DLGLOBAL DEBUG validating counter group 0x7f2859ce8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090221486 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090221486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090221487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090221487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090221489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090221489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090221489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090221489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:22.417544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminating (SIGTERM) 09:02:22.456749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminating (SIGTERM) 09:02:22.496065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Terminating (SIGTERM) 09:02:22.535381 --- ParallelTerminationStrategy: PID 29361 died... 09:02:22.554744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminated: ok {rc=0} 09:02:22.598387 --- ParallelTerminationStrategy: PID 29364 died... 09:02:22.617210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminated: ok {rc=0} 09:02:22.660668 --- ParallelTerminationStrategy: PID 29367 died... 09:02:22.679436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29367): Terminated: ok {rc=0} 09:02:22.765346 bus /sierra_3: Setting Powered False 09:02:23.863231 bus /sierra_3: Setting Powered False 09:02:24.975251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:02:26.226929 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:26.234088 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:02:26.268500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:02:26.296095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:02:26.352685 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:02:26.387505 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:02:26.415235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:02:26.963850 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:02:27.015317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:27.027152 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:02:27.098767 tst mo_mt_call.py: using LAC 32889 09:02:27.223447 tst mo_mt_call.py: using RAC 249 09:02:27.345385 tst mo_mt_call.py: using CellId 32889 09:02:27.470828 tst mo_mt_call.py: using BVCI 32890 09:02:27.586330 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:27.597891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:27.609325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:27.620706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:27.632351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:27.643914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:02:27.761107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:02:27.875640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:28.332791 run create_hlr_db(pid=29373): Launched 09:02:28.446683 bus /sierra_2: Setting Powered False 09:02:29.505801 run create_hlr_db(pid=29373): Terminated: ok {rc=0} 09:02:29.916574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29375): Launched 09:02:30.210821 run osmo-hlr_10.42.42.2(pid=29376): Launched 09:02:30.323646 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:30.827569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29378): Launched 09:02:31.139598 run osmo-stp_10.42.42.5(pid=29379): Launched 09:02:31.259629 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:32.099771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29381): Launched 09:02:32.417890 run osmo-msc_10.42.42.6(pid=29382): Launched 09:02:32.626072 run osmo-stp_10.42.42.5(pid=29379): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29379)] 09:02:32.759965 run osmo-stp_10.42.42.5(pid=29379): stdout: | (launched: 2022-12-13_09:02:31.078541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:32.894382 run osmo-stp_10.42.42.5(pid=29379): stderr: | 20221213090231457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090231458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090231459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090231462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090231463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090231463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090231463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:33.027696 run osmo-stp_10.42.42.5(pid=29379): stdout: | (launched: 2022-12-13_09:02:31.078541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:33.154231 run osmo-stp_10.42.42.5(pid=29379): stderr: | 20221213090231457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090231458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090231459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090231462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090231463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090231463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090231463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:33.306877 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29379): Process ended prematurely: osmo-stp_10.42.42.5(pid=29379) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29379)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:02:33.316431 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:02:33.344191 run osmo-hlr_10.42.42.2(pid=29376): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29376)] 09:02:33.394276 run osmo-hlr_10.42.42.2(pid=29376): stdout: | (launched: 2022-12-13_09:02:30.157253) 09:02:33.445778 run osmo-hlr_10.42.42.2(pid=29376): stderr: | 20221213090230334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090230334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090230334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090230334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090230334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090230334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090230346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090230354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090230355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090230355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:33.517538 run osmo-msc_10.42.42.6(pid=29382): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29382)] 09:02:33.567146 run osmo-msc_10.42.42.6(pid=29382): stdout: | (launched: 2022-12-13_09:02:32.361439) 09:02:33.618167 run osmo-msc_10.42.42.6(pid=29382): stderr: | 20221213090232680 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090232680 DLGLOBAL DEBUG validating counter group 0x7f7f50223c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090232680 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090232680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090232680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090232680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090232682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090232683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090232683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090232683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:33.669702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29375): Terminating (SIGTERM) 09:02:33.711507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29378): Terminating (SIGTERM) 09:02:33.753087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29381): Terminating (SIGTERM) 09:02:33.794766 --- ParallelTerminationStrategy: PID 29375 died... 09:02:33.814589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29375): Terminated: ok {rc=0} 09:02:33.860779 --- ParallelTerminationStrategy: PID 29378 died... 09:02:33.880392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29378): Terminated: ok {rc=0} 09:02:33.926486 --- ParallelTerminationStrategy: PID 29381 died... 09:02:33.946047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29381): Terminated: ok {rc=0} 09:02:34.033217 bus /sierra_3: Setting Powered False 09:02:35.130753 bus /sierra_3: Setting Powered False 09:02:36.244243 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:02:37.391214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:37.403581 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:02:37.475667 tst mo_mt_call_osmux.py: using LAC 32890 09:02:37.601049 tst mo_mt_call_osmux.py: using RAC 250 09:02:37.724601 tst mo_mt_call_osmux.py: using CellId 32890 09:02:37.848197 tst mo_mt_call_osmux.py: using BVCI 32891 09:02:37.957260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:37.968706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:37.980005 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:37.991154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:38.002824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:02:38.014470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:02:38.133682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:02:38.249838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:38.707997 run create_hlr_db(pid=29385): Launched 09:02:38.820894 bus /sierra_2: Setting Powered False 09:02:39.878765 run create_hlr_db(pid=29385): Terminated: ok {rc=0} 09:02:40.290444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Launched 09:02:40.585268 run osmo-hlr_10.42.42.2(pid=29388): Launched 09:02:40.699031 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:41.225671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Launched 09:02:41.542366 run osmo-stp_10.42.42.5(pid=29391): Launched 09:02:41.663735 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:42.237538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29393): Launched 09:02:42.554623 run osmo-msc_10.42.42.6(pid=29394): Launched 09:02:42.731889 run osmo-stp_10.42.42.5(pid=29391): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] 09:02:42.865467 run osmo-stp_10.42.42.5(pid=29391): stdout: | (launched: 2022-12-13_09:02:41.485449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:42.999968 run osmo-stp_10.42.42.5(pid=29391): stderr: | 20221213090241676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090241676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090241676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090241677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090241677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090241677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090241677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:43.134585 run osmo-stp_10.42.42.5(pid=29391): stdout: | (launched: 2022-12-13_09:02:41.485449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:43.261242 run osmo-stp_10.42.42.5(pid=29391): stderr: | 20221213090241676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090241676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090241676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090241677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090241677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090241677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090241677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:43.412814 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29391): Process ended prematurely: osmo-stp_10.42.42.5(pid=29391) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:02:43.422692 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:02:43.450265 run osmo-hlr_10.42.42.2(pid=29388): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29388)] 09:02:43.500704 run osmo-hlr_10.42.42.2(pid=29388): stdout: | (launched: 2022-12-13_09:02:40.531249) 09:02:43.552438 run osmo-hlr_10.42.42.2(pid=29388): stderr: | 20221213090240708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090240708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090240708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090240708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090240708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090240708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090240720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090240728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090240728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090240728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:43.624403 run osmo-msc_10.42.42.6(pid=29394): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29394)] 09:02:43.673751 run osmo-msc_10.42.42.6(pid=29394): stdout: | (launched: 2022-12-13_09:02:42.497420) 09:02:43.725290 run osmo-msc_10.42.42.6(pid=29394): stderr: | 20221213090242821 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090242821 DLGLOBAL DEBUG validating counter group 0x7fa199283c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090242821 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090242821 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090242821 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090242822 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090242823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090242824 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090242824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090242824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:43.777153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Terminating (SIGTERM) 09:02:43.818361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Terminating (SIGTERM) 09:02:43.860546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29393): Terminating (SIGTERM) 09:02:43.903057 --- ParallelTerminationStrategy: PID 29387 died... 09:02:43.923373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Terminated: ok {rc=0} 09:02:43.969430 --- ParallelTerminationStrategy: PID 29390 died... 09:02:43.989179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Terminated: ok {rc=0} 09:02:44.035520 --- ParallelTerminationStrategy: PID 29393 died... 09:02:44.055341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29393): Terminated: ok {rc=0} 09:02:44.142596 bus /sierra_3: Setting Powered False 09:02:45.239666 bus /sierra_3: Setting Powered False 09:02:46.353183 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:02:47.609839 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:47.616802 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:02:47.650895 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:02:47.678637 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:02:47.731217 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:02:47.764014 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:02:47.790521 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:02:48.346145 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:02:48.396887 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:48.408886 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:02:48.481441 tst mo_mt_call.py: using LAC 32891 09:02:48.605198 tst mo_mt_call.py: using RAC 251 09:02:48.730870 tst mo_mt_call.py: using CellId 32891 09:02:48.855775 tst mo_mt_call.py: using BVCI 32892 09:02:48.969644 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:48.981323 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:48.992666 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:49.004367 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:49.015985 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:49.027538 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:02:49.144571 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:02:49.262429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:49.750692 run create_hlr_db(pid=29399): Launched 09:02:49.877996 bus /sierra_2: Setting Powered False 09:02:50.941118 run create_hlr_db(pid=29399): Terminated: ok {rc=0} 09:02:51.379431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29401): Launched 09:02:51.693701 run osmo-hlr_10.42.42.2(pid=29402): Launched 09:02:51.813592 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:52.354585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29404): Launched 09:02:52.668924 run osmo-stp_10.42.42.5(pid=29405): Launched 09:02:52.789509 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:53.359683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29407): Launched 09:02:53.673755 run osmo-msc_10.42.42.6(pid=29408): Launched 09:02:53.849365 run osmo-stp_10.42.42.5(pid=29405): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29405)] 09:02:53.981950 run osmo-stp_10.42.42.5(pid=29405): stdout: | (launched: 2022-12-13_09:02:52.612085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:54.115579 run osmo-stp_10.42.42.5(pid=29405): stderr: | 20221213090252803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090252803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090252804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090252804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090252805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090252805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090252805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:54.248388 run osmo-stp_10.42.42.5(pid=29405): stdout: | (launched: 2022-12-13_09:02:52.612085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:54.374450 run osmo-stp_10.42.42.5(pid=29405): stderr: | 20221213090252803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090252803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090252804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090252804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090252805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090252805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090252805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:54.525712 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29405): Process ended prematurely: osmo-stp_10.42.42.5(pid=29405) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29405)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:02:54.535281 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:02:54.562619 run osmo-hlr_10.42.42.2(pid=29402): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29402)] 09:02:54.612056 run osmo-hlr_10.42.42.2(pid=29402): stdout: | (launched: 2022-12-13_09:02:51.636800) 09:02:54.663339 run osmo-hlr_10.42.42.2(pid=29402): stderr: | 20221213090251835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090251835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090251835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090251835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090251835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090251836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090251849 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090251859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090251859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090251859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:54.734767 run osmo-msc_10.42.42.6(pid=29408): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29408)] 09:02:54.784133 run osmo-msc_10.42.42.6(pid=29408): stdout: | (launched: 2022-12-13_09:02:53.617078) 09:02:54.834882 run osmo-msc_10.42.42.6(pid=29408): stderr: | 20221213090253941 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090253941 DLGLOBAL DEBUG validating counter group 0x7fc310d2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090253941 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090253941 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090253942 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090253942 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090253943 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090253944 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090253944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090253944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:54.886008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29401): Terminating (SIGTERM) 09:02:54.926927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29404): Terminating (SIGTERM) 09:02:54.967918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29407): Terminating (SIGTERM) 09:02:55.009433 --- ParallelTerminationStrategy: PID 29401 died... 09:02:55.028807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29401): Terminated: ok {rc=0} 09:02:55.074325 --- ParallelTerminationStrategy: PID 29404 died... 09:02:55.093590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29404): Terminated: ok {rc=0} 09:02:55.138954 --- ParallelTerminationStrategy: PID 29407 died... 09:02:55.158289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29407): Terminated: ok {rc=0} 09:02:55.244090 bus /sierra_3: Setting Powered False 09:02:56.340840 bus /sierra_3: Setting Powered False 09:02:57.452875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:02:58.598949 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:58.611328 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:02:58.684079 tst mo_mt_call_osmux.py: using LAC 32892 09:02:58.809746 tst mo_mt_call_osmux.py: using RAC 252 09:02:58.935617 tst mo_mt_call_osmux.py: using CellId 32892 09:02:59.059947 tst mo_mt_call_osmux.py: using BVCI 32893 09:02:59.175915 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:59.187569 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:59.199077 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:59.210567 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:59.222151 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:02:59.233580 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:02:59.350136 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:02:59.464882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:59.921548 run create_hlr_db(pid=29410): Launched 09:03:00.052034 bus /sierra_2: Setting Powered False 09:03:01.115066 run create_hlr_db(pid=29410): Terminated: ok {rc=0} 09:03:01.648201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29413): Launched 09:03:01.987694 run osmo-hlr_10.42.42.2(pid=29414): Launched 09:03:02.231669 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:02.815428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29416): Launched 09:03:03.130488 run osmo-stp_10.42.42.5(pid=29417): Launched 09:03:03.249764 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:03.819572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29419): Launched 09:03:04.135256 run osmo-msc_10.42.42.6(pid=29420): Launched 09:03:04.311398 run osmo-stp_10.42.42.5(pid=29417): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29417)] 09:03:04.444631 run osmo-stp_10.42.42.5(pid=29417): stdout: | (launched: 2022-12-13_09:03:03.073682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:04.579008 run osmo-stp_10.42.42.5(pid=29417): stderr: | 20221213090303266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090303266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090303266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090303267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090303267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090303267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090303267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:04.712196 run osmo-stp_10.42.42.5(pid=29417): stdout: | (launched: 2022-12-13_09:03:03.073682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:04.838204 run osmo-stp_10.42.42.5(pid=29417): stderr: | 20221213090303266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090303266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090303266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090303267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090303267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090303267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090303267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:04.988752 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29417): Process ended prematurely: osmo-stp_10.42.42.5(pid=29417) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29417)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:03:04.998497 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:03:05.026225 run osmo-hlr_10.42.42.2(pid=29414): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29414)] 09:03:05.075603 run osmo-hlr_10.42.42.2(pid=29414): stdout: | (launched: 2022-12-13_09:03:01.926449) 09:03:05.126870 run osmo-hlr_10.42.42.2(pid=29414): stderr: | 20221213090302238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090302238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090302238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090302238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090302238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090302238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090302250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090302263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090302263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090302263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:05.198090 run osmo-msc_10.42.42.6(pid=29420): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29420)] 09:03:05.247296 run osmo-msc_10.42.42.6(pid=29420): stdout: | (launched: 2022-12-13_09:03:04.078415) 09:03:05.298047 run osmo-msc_10.42.42.6(pid=29420): stderr: | 20221213090304398 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090304399 DLGLOBAL DEBUG validating counter group 0x7fe403345c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090304399 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090304399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090304399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090304399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090304401 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090304401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090304401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090304401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:05.349387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29413): Terminating (SIGTERM) 09:03:05.390296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29416): Terminating (SIGTERM) 09:03:05.431663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29419): Terminating (SIGTERM) 09:03:05.472775 --- ParallelTerminationStrategy: PID 29413 died... 09:03:05.492499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29413): Terminated: ok {rc=0} 09:03:05.538244 --- ParallelTerminationStrategy: PID 29416 died... 09:03:05.557775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29416): Terminated: ok {rc=0} 09:03:05.603304 --- ParallelTerminationStrategy: PID 29419 died... 09:03:05.622739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29419): Terminated: ok {rc=0} 09:03:05.709339 bus /sierra_3: Setting Powered False 09:03:06.804735 bus /sierra_3: Setting Powered False 09:03:07.918377 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:03:09.177538 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:09.183778 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:03:09.217909 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:03:09.245094 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:03:09.297143 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:03:09.331756 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:03:09.358860 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:03:09.910270 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:03:09.960581 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:09.971963 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:10.045083 tst mo_mt_call.py: using LAC 32893 09:03:10.170698 tst mo_mt_call.py: using RAC 253 09:03:10.295570 tst mo_mt_call.py: using CellId 32893 09:03:10.418963 tst mo_mt_call.py: using BVCI 32894 09:03:10.534673 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:10.546116 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:10.557318 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:10.568505 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:10.580102 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:10.591511 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:10.705769 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:10.819185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:11.276154 run create_hlr_db(pid=29427): Launched 09:03:11.389667 bus /sierra_2: Setting Powered False 09:03:12.448729 run create_hlr_db(pid=29427): Terminated: ok {rc=0} 09:03:12.880475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Launched 09:03:13.197024 run osmo-hlr_10.42.42.2(pid=29430): Launched 09:03:13.317733 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:13.863201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Launched 09:03:14.179419 run osmo-stp_10.42.42.5(pid=29433): Launched 09:03:14.300543 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:14.878903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Launched 09:03:15.194242 run osmo-msc_10.42.42.6(pid=29436): Launched 09:03:15.370390 run osmo-stp_10.42.42.5(pid=29433): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] 09:03:15.503860 run osmo-stp_10.42.42.5(pid=29433): stdout: | (launched: 2022-12-13_09:03:14.122552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:15.637298 run osmo-stp_10.42.42.5(pid=29433): stderr: | 20221213090314314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090314315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090314315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090314315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090314316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090314316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090314316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:15.770307 run osmo-stp_10.42.42.5(pid=29433): stdout: | (launched: 2022-12-13_09:03:14.122552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:15.902327 run osmo-stp_10.42.42.5(pid=29433): stderr: | 20221213090314314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090314315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090314315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090314315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090314316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090314316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090314316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:16.066816 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29433): Process ended prematurely: osmo-stp_10.42.42.5(pid=29433) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:03:16.077179 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:03:16.105345 run osmo-hlr_10.42.42.2(pid=29430): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29430)] 09:03:16.158869 run osmo-hlr_10.42.42.2(pid=29430): stdout: | (launched: 2022-12-13_09:03:13.140162) 09:03:16.212044 run osmo-hlr_10.42.42.2(pid=29430): stderr: | 20221213090313339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090313339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090313339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090313339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090313339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090313339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090313351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090313360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090313360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090313360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:16.283597 run osmo-msc_10.42.42.6(pid=29436): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29436)] 09:03:16.332537 run osmo-msc_10.42.42.6(pid=29436): stdout: | (launched: 2022-12-13_09:03:15.137333) 09:03:16.386645 run osmo-msc_10.42.42.6(pid=29436): stderr: | 20221213090315458 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090315458 DLGLOBAL DEBUG validating counter group 0x7fed56c8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090315458 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090315458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090315459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090315459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090315462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090315463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090315463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090315463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:16.438450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Terminating (SIGTERM) 09:03:16.480637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Terminating (SIGTERM) 09:03:16.524367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Terminating (SIGTERM) 09:03:16.569518 --- ParallelTerminationStrategy: PID 29429 died... 09:03:16.591848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Terminated: ok {rc=0} 09:03:16.639242 --- ParallelTerminationStrategy: PID 29432 died... 09:03:16.660131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Terminated: ok {rc=0} 09:03:16.706837 --- ParallelTerminationStrategy: PID 29435 died... 09:03:16.727538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Terminated: ok {rc=0} 09:03:16.817106 bus /sierra_3: Setting Powered False 09:03:17.912815 bus /sierra_3: Setting Powered False 09:03:19.027899 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:03:20.172923 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:20.184434 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:20.255095 tst mo_mt_call_osmux.py: using LAC 32894 09:03:20.371237 tst mo_mt_call_osmux.py: using RAC 254 09:03:20.497424 tst mo_mt_call_osmux.py: using CellId 32894 09:03:20.621077 tst mo_mt_call_osmux.py: using BVCI 32895 09:03:20.736356 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:20.748040 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:20.759571 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:20.770923 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:20.782370 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:20.793659 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:20.909773 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:21.032172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:21.521011 run create_hlr_db(pid=29438): Launched 09:03:21.648861 bus /sierra_2: Setting Powered False 09:03:22.712319 run create_hlr_db(pid=29438): Terminated: ok {rc=0} 09:03:23.132180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29440): Launched 09:03:23.425934 run osmo-hlr_10.42.42.2(pid=29441): Launched 09:03:23.538590 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:24.060490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29443): Launched 09:03:24.355320 run osmo-stp_10.42.42.5(pid=29444): Launched 09:03:24.470425 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:25.003885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29446): Launched 09:03:25.298616 run osmo-msc_10.42.42.6(pid=29447): Launched 09:03:25.463387 run osmo-stp_10.42.42.5(pid=29444): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29444)] 09:03:25.589873 run osmo-stp_10.42.42.5(pid=29444): stdout: | (launched: 2022-12-13_09:03:24.301598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:25.716187 run osmo-stp_10.42.42.5(pid=29444): stderr: | 20221213090324473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090324473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090324473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090324474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090324474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090324474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090324474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:25.839843 run osmo-stp_10.42.42.5(pid=29444): stdout: | (launched: 2022-12-13_09:03:24.301598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:25.958146 run osmo-stp_10.42.42.5(pid=29444): stderr: | 20221213090324473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090324473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090324473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090324474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090324474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090324474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090324474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:26.099753 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29444): Process ended prematurely: osmo-stp_10.42.42.5(pid=29444) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29444)] [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:03:26.108576 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:03:26.134435 run osmo-hlr_10.42.42.2(pid=29441): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29441)] 09:03:26.182850 run osmo-hlr_10.42.42.2(pid=29441): stdout: | (launched: 2022-12-13_09:03:23.372454) 09:03:26.232082 run osmo-hlr_10.42.42.2(pid=29441): stderr: | 20221213090323545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090323545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090323545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090323545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090323545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090323545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090323557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090323566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090323566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090323566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:26.300897 run osmo-msc_10.42.42.6(pid=29447): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29447)] 09:03:26.347792 run osmo-msc_10.42.42.6(pid=29447): stdout: | (launched: 2022-12-13_09:03:25.244813) 09:03:26.396909 run osmo-msc_10.42.42.6(pid=29447): stderr: | 20221213090325517 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090325517 DLGLOBAL DEBUG validating counter group 0x7fbeefa5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090325518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090325518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090325518 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090325518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090325520 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090325520 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090325520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090325520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:26.446328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29440): Terminating (SIGTERM) 09:03:26.485689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29443): Terminating (SIGTERM) 09:03:26.525174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29446): Terminating (SIGTERM) 09:03:26.564899 --- ParallelTerminationStrategy: PID 29440 died... 09:03:26.584052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29440): Terminated: ok {rc=0} 09:03:26.627963 --- ParallelTerminationStrategy: PID 29443 died... 09:03:26.646444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29443): Terminated: ok {rc=0} 09:03:26.689914 --- ParallelTerminationStrategy: PID 29446 died... 09:03:26.708628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29446): Terminated: ok {rc=0} 09:03:26.792486 bus /sierra_3: Setting Powered False 09:03:27.889568 bus /sierra_3: Setting Powered False 09:03:29.004854 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 09:03:30.258729 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:30.263267 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 09:03:30.297288 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:03:30.324541 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 09:03:30.408579 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 09:03:30.443105 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:03:30.470302 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 09:03:31.070886 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 09:03:31.079331 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:31.097515 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:03:31.149992 tst emergency_mo_mt_call.py: using LAC 32895 09:03:31.274453 tst emergency_mo_mt_call.py: using RAC 255 09:03:31.417193 tst emergency_mo_mt_call.py: using CellId 32895 09:03:31.534650 tst emergency_mo_mt_call.py: using BVCI 32896 09:03:31.650029 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:31.661871 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:31.674290 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:31.686523 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:31.698845 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:31.711282 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:31.829660 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:31.948855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:32.436905 run create_hlr_db(pid=29453): Launched 09:03:32.563487 bus /sierra_2: Setting Powered False 09:03:33.624895 run create_hlr_db(pid=29453): Terminated: ok {rc=0} 09:03:34.057172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29455): Launched 09:03:34.365718 run osmo-hlr_10.42.42.2(pid=29456): Launched 09:03:34.483069 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:35.021712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29458): Launched 09:03:35.331179 run osmo-stp_10.42.42.5(pid=29459): Launched 09:03:35.457584 tst emergency_mo_mt_call.py: using MSISDN 8076 09:03:35.618481 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:36.178022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29461): Launched 09:03:36.487301 run osmo-msc_10.42.42.6(pid=29462): Launched 09:03:36.659917 run osmo-stp_10.42.42.5(pid=29459): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29459)] 09:03:36.791649 run osmo-stp_10.42.42.5(pid=29459): stdout: | (launched: 2022-12-13_09:03:35.275163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:36.923664 run osmo-stp_10.42.42.5(pid=29459): stderr: | 20221213090335466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090335466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090335467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090335467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090335467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090335467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090335468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:37.055718 run osmo-stp_10.42.42.5(pid=29459): stdout: | (launched: 2022-12-13_09:03:35.275163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:37.179797 run osmo-stp_10.42.42.5(pid=29459): stderr: | 20221213090335466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090335466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090335467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090335467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090335467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090335467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090335468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:37.327916 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29459): Process ended prematurely: osmo-stp_10.42.42.5(pid=29459) [trial-2387↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29459)] [trial-2387↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 09:03:37.337320 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 09:03:37.364066 run osmo-hlr_10.42.42.2(pid=29456): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29456)] 09:03:37.413863 run osmo-hlr_10.42.42.2(pid=29456): stdout: | (launched: 2022-12-13_09:03:34.309687) 09:03:37.465385 run osmo-hlr_10.42.42.2(pid=29456): stderr: | 20221213090334507 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090334507 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090334507 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090334507 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090334507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090334507 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090334519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090334530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090334530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090334530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:37.536629 run osmo-msc_10.42.42.6(pid=29462): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29462)] 09:03:37.586339 run osmo-msc_10.42.42.6(pid=29462): stdout: | (launched: 2022-12-13_09:03:36.431226) 09:03:37.637719 run osmo-msc_10.42.42.6(pid=29462): stderr: | 20221213090336751 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090336751 DLGLOBAL DEBUG validating counter group 0x7f2f2fddcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090336751 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090336751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090336751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090336752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090336754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090336755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090336755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090336755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:37.689429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29455): Terminating (SIGTERM) 09:03:37.730751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29458): Terminating (SIGTERM) 09:03:37.772093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29461): Terminating (SIGTERM) 09:03:37.813638 --- ParallelTerminationStrategy: PID 29455 died... 09:03:37.833487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29455): Terminated: ok {rc=0} 09:03:37.879440 --- ParallelTerminationStrategy: PID 29458 died... 09:03:37.898834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29458): Terminated: ok {rc=0} 09:03:37.944394 --- ParallelTerminationStrategy: PID 29461 died... 09:03:37.963640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29461): Terminated: ok {rc=0} 09:03:38.051472 bus /sierra_3: Setting Powered False 09:03:39.149571 bus /sierra_3: Setting Powered False 09:03:40.263736 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 09:03:41.348712 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:41.360493 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:03:41.417409 tst emergency_preemptive_call.py: using LAC 32896 09:03:41.540719 tst emergency_preemptive_call.py: using RAC 1 09:03:41.662106 tst emergency_preemptive_call.py: using CellId 32896 09:03:41.782143 tst emergency_preemptive_call.py: using BVCI 32897 09:03:41.893930 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:41.905222 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:41.916206 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:41.927344 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:41.938718 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:03:41.949793 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:42.064385 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:42.178338 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:42.295709 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:42.411989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:42.863454 run create_hlr_db(pid=29464): Launched 09:03:42.975572 bus /sierra_2: Setting Powered False 09:03:44.033234 run create_hlr_db(pid=29464): Terminated: ok {rc=0} 09:03:44.458298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Launched 09:03:44.767934 run osmo-hlr_10.42.42.2(pid=29467): Launched 09:03:44.887108 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:45.426345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Launched 09:03:45.735773 run osmo-stp_10.42.42.5(pid=29470): Launched 09:03:45.862730 tst emergency_preemptive_call.py: using MSISDN 8077 09:03:46.134713 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:46.680789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29472): Launched 09:03:47.008790 run osmo-msc_10.42.42.6(pid=29473): Launched 09:03:47.211789 run osmo-stp_10.42.42.5(pid=29470): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] 09:03:47.458931 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-13_09:03:45.679599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:47.599542 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221213090345871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090345871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090345872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090345872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090345872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090345872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090345880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:47.722043 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-13_09:03:45.679599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:47.838822 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221213090345871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090345871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090345872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090345872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090345872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090345872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090345880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:47.977641 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2387↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] [trial-2387↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 09:03:47.986261 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 09:03:48.012387 run osmo-hlr_10.42.42.2(pid=29467): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29467)] 09:03:48.061784 run osmo-hlr_10.42.42.2(pid=29467): stdout: | (launched: 2022-12-13_09:03:44.711807) 09:03:48.112098 run osmo-hlr_10.42.42.2(pid=29467): stderr: | 20221213090344907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090344907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090344907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090344907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090344907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090344907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090344922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090344931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090344931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090344931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:48.182713 run osmo-msc_10.42.42.6(pid=29473): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29473)] 09:03:48.230592 run osmo-msc_10.42.42.6(pid=29473): stdout: | (launched: 2022-12-13_09:03:46.939006) 09:03:48.280463 run osmo-msc_10.42.42.6(pid=29473): stderr: | 20221213090347429 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090347429 DLGLOBAL DEBUG validating counter group 0x7f7f1d6f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090347429 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090347429 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090347430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090347430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090347432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090347432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090347432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090347432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:48.330625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminating (SIGTERM) 09:03:48.371017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminating (SIGTERM) 09:03:48.411313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29472): Terminating (SIGTERM) 09:03:48.451758 --- ParallelTerminationStrategy: PID 29466 died... 09:03:48.471599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminated: ok {rc=0} 09:03:48.516193 --- ParallelTerminationStrategy: PID 29469 died... 09:03:48.535479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminated: ok {rc=0} 09:03:48.580068 --- ParallelTerminationStrategy: PID 29472 died... 09:03:48.599623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29472): Terminated: ok {rc=0} 09:03:48.685754 bus /sierra_9: Setting Powered False 09:03:49.783940 bus /sierra_9: Setting Powered False 09:03:50.899684 bus /sierra_8: Setting Powered False 09:03:51.997227 bus /sierra_8: Setting Powered False 09:03:53.114030 bus /sierra_3: Setting Powered False 09:03:54.211419 bus /sierra_3: Setting Powered False 09:03:55.326979 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 09:03:56.602009 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:56.607502 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 09:03:56.641791 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 09:03:56.680717 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 09:03:56.770547 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 09:03:56.804808 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 09:03:56.843748 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 09:03:57.435938 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 09:03:57.486239 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:57.497224 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:03:57.546479 tst cs_paging_gprs_active.py: using LAC 32897 09:03:57.673093 tst cs_paging_gprs_active.py: using RAC 2 09:03:57.799661 tst cs_paging_gprs_active.py: using CellId 32897 09:03:57.925258 tst cs_paging_gprs_active.py: using BVCI 32898 09:03:58.040722 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.052063 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.063111 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.074203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.085100 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.096150 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.107224 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.118102 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:03:58.129807 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:58.246264 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:03:58.361117 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:03:58.560175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:58.858058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29478): Launched 09:03:59.116313 run iperf3-srv_10.42.42.10(pid=29479): Launched 09:03:59.227679 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:03:59.426169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:59.741599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29480): Launched 09:04:00.016522 run iperf3-srv_10.42.42.10(pid=29481): Launched 09:04:00.135787 tst cs_paging_gprs_active.py:38: start network... 09:04:00.349513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:00.840074 run create_hlr_db(pid=29482): Launched 09:04:01.015273 bus /sierra_2: Setting Powered False 09:04:02.090153 run create_hlr_db(pid=29482): Terminated: ok {rc=0} 09:04:02.555782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29484): Launched 09:04:02.872147 run osmo-hlr_10.42.42.2(pid=29485): Launched 09:04:02.993400 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:03.538691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29487): Launched 09:04:03.854204 run osmo-stp_10.42.42.5(pid=29488): Launched 09:04:03.974483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:04.492815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29490): Launched 09:04:04.607912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:04.858435 run patchelf(pid=29491): Launched 09:04:05.023821 run osmo-stp_10.42.42.5(pid=29488): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29488)] 09:04:05.149867 run osmo-stp_10.42.42.5(pid=29488): stdout: | (launched: 2022-12-13_09:04:03.797155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:05.277461 run osmo-stp_10.42.42.5(pid=29488): stderr: | 20221213090403991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090403991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090403991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090403992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090403992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090403992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090403992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:05.405400 run osmo-stp_10.42.42.5(pid=29488): stdout: | (launched: 2022-12-13_09:04:03.797155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:05.527279 run osmo-stp_10.42.42.5(pid=29488): stderr: | 20221213090403991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090403991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090403991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090403992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090403992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090403992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090403992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:05.672005 run patchelf(pid=29491): Terminating (SIGINT) 09:04:05.839162 run patchelf(pid=29491): Terminated: ok {rc=0} 09:04:05.959852 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29488): Process ended prematurely: osmo-stp_10.42.42.5(pid=29488) [trial-2387↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29488)] [trial-2387↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 09:04:05.969392 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:04:05.996015 run osmo-hlr_10.42.42.2(pid=29485): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29485)] 09:04:06.043320 run osmo-hlr_10.42.42.2(pid=29485): stdout: | (launched: 2022-12-13_09:04:02.814974) 09:04:06.092417 run osmo-hlr_10.42.42.2(pid=29485): stderr: | 20221213090403011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090403011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090403011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090403011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090403011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090403011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090403043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090403052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090403052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090403052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:06.142290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29478): Terminating (SIGTERM) 09:04:06.182010 run iperf3-srv_10.42.42.10(pid=29479): Terminating (SIGTERM) 09:04:06.221400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29480): Terminating (SIGTERM) 09:04:06.261081 run iperf3-srv_10.42.42.10(pid=29481): Terminating (SIGTERM) 09:04:06.300506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29484): Terminating (SIGTERM) 09:04:06.340196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29487): Terminating (SIGTERM) 09:04:06.379764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29490): Terminating (SIGTERM) 09:04:06.419563 --- ParallelTerminationStrategy: PID 29478 died... 09:04:06.438916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29478): Terminated: ok {rc=0} 09:04:06.482961 --- ParallelTerminationStrategy: PID 29479 died... 09:04:06.501708 run iperf3-srv_10.42.42.10(pid=29479): Terminated {rc=256} 09:04:06.545380 --- ParallelTerminationStrategy: PID 29480 died... 09:04:06.564356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29480): Terminated: ok {rc=0} 09:04:06.608049 --- ParallelTerminationStrategy: PID 29481 died... 09:04:06.626842 run iperf3-srv_10.42.42.10(pid=29481): Terminated {rc=256} 09:04:06.670604 --- ParallelTerminationStrategy: PID 29484 died... 09:04:06.689482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29484): Terminated: ok {rc=0} 09:04:06.733263 --- ParallelTerminationStrategy: PID 29487 died... 09:04:06.752087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29487): Terminated: ok {rc=0} 09:04:06.797332 --- ParallelTerminationStrategy: PID 29490 died... 09:04:06.817886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29490): Terminated: ok {rc=0} 09:04:06.904199 bus /gobi_0: Setting Powered False 09:04:08.002359 bus /gobi_0: Setting Powered False 09:04:09.118526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 09:04:10.263132 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.274405 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:04:10.326865 tst iperf3.py: using LAC 32898 09:04:10.444640 tst iperf3.py: using RAC 3 09:04:10.564402 tst iperf3.py: using CellId 32898 09:04:10.680055 tst iperf3.py: using BVCI 32899 09:04:10.788825 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.799574 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.810014 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.820383 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.830794 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.842325 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.853582 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.864337 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:10.875302 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:04:10.994546 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:04:11.210359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:11.527145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29492): Launched 09:04:11.801938 run iperf3-srv_10.42.42.10(pid=29493): Launched 09:04:11.920655 tst iperf3.py:8: start network... 09:04:12.135073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:12.625524 run create_hlr_db(pid=29494): Launched 09:04:12.754275 bus /gobi_6: Setting Powered False 09:04:13.816717 run create_hlr_db(pid=29494): Terminated: ok {rc=0} 09:04:14.240351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Launched 09:04:14.536354 run osmo-hlr_10.42.42.2(pid=29497): Launched 09:04:14.651185 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:15.178907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Launched 09:04:15.474427 run osmo-stp_10.42.42.5(pid=29500): Launched 09:04:15.588262 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:16.150341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Launched 09:04:16.282945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:16.566309 run patchelf(pid=29503): Launched 09:04:16.748203 run osmo-stp_10.42.42.5(pid=29500): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] 09:04:16.886669 run osmo-stp_10.42.42.5(pid=29500): stdout: | (launched: 2022-12-13_09:04:15.420792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:17.026856 run osmo-stp_10.42.42.5(pid=29500): stderr: | 20221213090415588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090415589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090415589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090415589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090415592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090415592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090415592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:17.166897 run osmo-stp_10.42.42.5(pid=29500): stdout: | (launched: 2022-12-13_09:04:15.420792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:17.299113 run osmo-stp_10.42.42.5(pid=29500): stderr: | 20221213090415588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090415589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090415589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090415589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090415592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090415592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090415592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:17.453359 run patchelf(pid=29503): Terminating (SIGINT) 09:04:17.630947 run patchelf(pid=29503): Terminated: ok {rc=0} 09:04:17.759586 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29500): Process ended prematurely: osmo-stp_10.42.42.5(pid=29500) [trial-2387↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] [trial-2387↪gprs:trx-sysmocell5000↪iperf3.py:8] 09:04:17.769978 tst iperf3.py:8: Test FAILED (7.5 sec) 09:04:17.798376 run osmo-hlr_10.42.42.2(pid=29497): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29497)] 09:04:17.848643 run osmo-hlr_10.42.42.2(pid=29497): stdout: | (launched: 2022-12-13_09:04:14.482469) 09:04:17.900855 run osmo-hlr_10.42.42.2(pid=29497): stderr: | 20221213090414657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090414657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090414657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090414657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090414657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090414657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090414669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090414678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090414678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090414678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:17.953543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29492): Terminating (SIGTERM) 09:04:17.995311 run iperf3-srv_10.42.42.10(pid=29493): Terminating (SIGTERM) 09:04:18.037011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Terminating (SIGTERM) 09:04:18.079150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Terminating (SIGTERM) 09:04:18.121771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Terminating (SIGTERM) 09:04:18.164133 --- ParallelTerminationStrategy: PID 29492 died... 09:04:18.184393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29492): Terminated: ok {rc=0} 09:04:18.231130 --- ParallelTerminationStrategy: PID 29493 died... 09:04:18.250753 run iperf3-srv_10.42.42.10(pid=29493): Terminated {rc=256} 09:04:18.296744 --- ParallelTerminationStrategy: PID 29496 died... 09:04:18.316559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29496): Terminated: ok {rc=0} 09:04:18.362676 --- ParallelTerminationStrategy: PID 29499 died... 09:04:18.382264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29499): Terminated: ok {rc=0} 09:04:18.428796 --- ParallelTerminationStrategy: PID 29502 died... 09:04:18.449218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29502): Terminated: ok {rc=0} 09:04:18.536910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 09:04:19.684713 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:19.696068 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:04:19.744382 tst iperf3m4.py: using LAC 32899 09:04:19.869398 tst iperf3m4.py: using RAC 4 09:04:19.993088 tst iperf3m4.py: using CellId 32899 09:04:20.117680 tst iperf3m4.py: using BVCI 32900 09:04:20.233662 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.245164 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.256364 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.267333 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.278293 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.289238 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.300334 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.311365 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:20.322499 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:04:20.439079 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:04:20.557928 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:04:20.676873 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:04:20.794256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:04:20.992415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:21.288462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29504): Launched 09:04:21.545781 run iperf3-srv_10.42.42.10(pid=29505): Launched 09:04:21.657077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:04:21.855303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:22.152771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29506): Launched 09:04:22.409799 run iperf3-srv_10.42.42.10(pid=29507): Launched 09:04:22.521543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:04:22.720070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:23.017699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Launched 09:04:23.275549 run iperf3-srv_10.42.42.10(pid=29509): Launched 09:04:23.386750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:04:23.585278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:23.881802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29510): Launched 09:04:24.139005 run iperf3-srv_10.42.42.10(pid=29511): Launched 09:04:24.250263 tst iperf3m4.py:8: start network... 09:04:24.448924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:24.906885 run create_hlr_db(pid=29512): Launched 09:04:25.021263 bus /gobi_6: Setting Powered False 09:04:26.080260 run create_hlr_db(pid=29512): Terminated: ok {rc=0} 09:04:26.512385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Launched 09:04:26.829334 run osmo-hlr_10.42.42.2(pid=29515): Launched 09:04:26.950740 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:27.502588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Launched 09:04:27.819321 run osmo-stp_10.42.42.5(pid=29518): Launched 09:04:27.940259 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:28.489299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Launched 09:04:28.609991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:28.877302 run patchelf(pid=29521): Launched 09:04:29.053583 run osmo-stp_10.42.42.5(pid=29518): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] 09:04:29.187922 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-13_09:04:27.761940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:29.324403 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221213090427953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090427953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090427953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090427954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090427954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090427954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090427954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:29.460601 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-13_09:04:27.761940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:29.590937 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221213090427953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090427953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090427953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090427954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090427954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090427954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090427954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:29.745229 run patchelf(pid=29521): Terminating (SIGINT) 09:04:29.922832 run patchelf(pid=29521): Terminated: ok {rc=0} 09:04:30.051048 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2387↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] [trial-2387↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 09:04:30.061515 tst iperf3m4.py:8: Test FAILED (10.4 sec) 09:04:30.089993 run osmo-hlr_10.42.42.2(pid=29515): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29515)] 09:04:30.140229 run osmo-hlr_10.42.42.2(pid=29515): stdout: | (launched: 2022-12-13_09:04:26.771905) 09:04:30.192325 run osmo-hlr_10.42.42.2(pid=29515): stderr: | 20221213090426968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090426968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090426968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090426968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090426968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090426968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090426982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090426990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090426991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090426991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:30.244538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29504): Terminating (SIGTERM) 09:04:30.286584 run iperf3-srv_10.42.42.10(pid=29505): Terminating (SIGTERM) 09:04:30.328937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29506): Terminating (SIGTERM) 09:04:30.371075 run iperf3-srv_10.42.42.10(pid=29507): Terminating (SIGTERM) 09:04:30.414002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Terminating (SIGTERM) 09:04:30.456423 run iperf3-srv_10.42.42.10(pid=29509): Terminating (SIGTERM) 09:04:30.498579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29510): Terminating (SIGTERM) 09:04:30.540815 run iperf3-srv_10.42.42.10(pid=29511): Terminating (SIGTERM) 09:04:30.583011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminating (SIGTERM) 09:04:30.624545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminating (SIGTERM) 09:04:30.666767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Terminating (SIGTERM) 09:04:30.709308 --- ParallelTerminationStrategy: PID 29504 died... 09:04:30.729410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29504): Terminated: ok {rc=0} 09:04:30.775444 --- ParallelTerminationStrategy: PID 29505 died... 09:04:30.794822 run iperf3-srv_10.42.42.10(pid=29505): Terminated {rc=256} 09:04:30.840653 --- ParallelTerminationStrategy: PID 29506 died... 09:04:30.860067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29506): Terminated: ok {rc=0} 09:04:30.907242 --- ParallelTerminationStrategy: PID 29507 died... 09:04:30.927455 run iperf3-srv_10.42.42.10(pid=29507): Terminated {rc=256} 09:04:30.974431 --- ParallelTerminationStrategy: PID 29508 died... 09:04:30.994483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Terminated: ok {rc=0} 09:04:31.043199 --- ParallelTerminationStrategy: PID 29509 died... 09:04:31.063761 run iperf3-srv_10.42.42.10(pid=29509): Terminated {rc=256} 09:04:31.110790 --- ParallelTerminationStrategy: PID 29510 died... 09:04:31.131098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29510): Terminated: ok {rc=0} 09:04:31.177910 --- ParallelTerminationStrategy: PID 29511 died... 09:04:31.197950 run iperf3-srv_10.42.42.10(pid=29511): Terminated {rc=256} 09:04:31.245131 --- ParallelTerminationStrategy: PID 29514 died... 09:04:31.265509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminated: ok {rc=0} 09:04:31.312496 --- ParallelTerminationStrategy: PID 29517 died... 09:04:31.332709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminated: ok {rc=0} 09:04:31.379493 --- ParallelTerminationStrategy: PID 29520 died... 09:04:31.399500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Terminated: ok {rc=0} 09:04:31.489580 bus /gobi_4: Setting Powered False 09:04:32.588121 bus /gobi_4: Setting Powered False 09:04:33.707028 bus /gobi_1: Setting Powered False 09:04:34.806616 bus /gobi_1: Setting Powered False 09:04:35.922773 bus /gobi_0: Setting Powered False 09:04:37.020765 bus /gobi_0: Setting Powered False 09:04:38.135410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 09:04:39.239836 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.251555 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:04:39.302529 tst ping.py: using LAC 32900 09:04:39.424929 tst ping.py: using RAC 5 09:04:39.541358 tst ping.py: using CellId 32900 09:04:39.656322 tst ping.py: using BVCI 32901 09:04:39.762331 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.773215 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.784013 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.794573 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.805429 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.816566 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.827670 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:39.838781 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:04:39.956704 tst ping.py:19: start network... 09:04:40.166807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:40.647336 run create_hlr_db(pid=29523): Launched 09:04:40.774085 bus /gobi_6: Setting Powered False 09:04:41.836064 run create_hlr_db(pid=29523): Terminated: ok {rc=0} 09:04:42.250384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29525): Launched 09:04:42.539975 run osmo-hlr_10.42.42.2(pid=29526): Launched 09:04:42.651953 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:43.167139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29528): Launched 09:04:43.458230 run osmo-stp_10.42.42.5(pid=29529): Launched 09:04:43.569455 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:44.073118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29531): Launched 09:04:44.184233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:44.430188 run patchelf(pid=29532): Launched 09:04:44.591876 run osmo-stp_10.42.42.5(pid=29529): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29529)] 09:04:44.715668 run osmo-stp_10.42.42.5(pid=29529): stdout: | (launched: 2022-12-13_09:04:43.405150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:44.840445 run osmo-stp_10.42.42.5(pid=29529): stderr: | 20221213090443572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090443572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090443572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090443573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090443573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090443573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090443573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:44.965845 run osmo-stp_10.42.42.5(pid=29529): stdout: | (launched: 2022-12-13_09:04:43.405150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:45.085880 run osmo-stp_10.42.42.5(pid=29529): stderr: | 20221213090443572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090443572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090443572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090443573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090443573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090443573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090443573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:45.228112 run patchelf(pid=29532): Terminating (SIGINT) 09:04:45.391322 run patchelf(pid=29532): Terminated: ok {rc=0} 09:04:45.508516 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29529): Process ended prematurely: osmo-stp_10.42.42.5(pid=29529) [trial-2387↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29529)] [trial-2387↪gprs:trx-sysmocell5000↪ping.py:22] 09:04:45.517346 tst ping.py:22: Test FAILED (6.3 sec) 09:04:45.543681 run osmo-hlr_10.42.42.2(pid=29526): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29526)] 09:04:45.591867 run osmo-hlr_10.42.42.2(pid=29526): stdout: | (launched: 2022-12-13_09:04:42.487061) 09:04:45.641212 run osmo-hlr_10.42.42.2(pid=29526): stderr: | 20221213090442663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090442663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090442663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090442663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090442663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090442663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090442677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090442687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090442687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090442687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:45.690639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29525): Terminating (SIGTERM) 09:04:45.730379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29528): Terminating (SIGTERM) 09:04:45.770154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29531): Terminating (SIGTERM) 09:04:45.810105 --- ParallelTerminationStrategy: PID 29525 died... 09:04:45.829557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29525): Terminated: ok {rc=0} 09:04:45.876363 --- ParallelTerminationStrategy: PID 29528 died... 09:04:45.897140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29528): Terminated: ok {rc=0} 09:04:45.946298 --- ParallelTerminationStrategy: PID 29531 died... 09:04:45.974654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29531): Terminated: ok {rc=0} 09:04:46.069987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 09:04:47.152874 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.164743 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 09:04:47.216840 tst ping_idle_ping.py: using LAC 32901 09:04:47.336268 tst ping_idle_ping.py: using RAC 6 09:04:47.452519 tst ping_idle_ping.py: using CellId 32901 09:04:47.567815 tst ping_idle_ping.py: using BVCI 32902 09:04:47.673282 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.684008 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.694526 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.705040 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.715683 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.726996 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.738025 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 09:04:47.748670 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 09:04:47.863086 tst ping_idle_ping.py:24: start network... 09:04:48.057338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:48.510519 run create_hlr_db(pid=29533): Launched 09:04:48.621408 bus /gobi_6: Setting Powered False 09:04:49.684155 run create_hlr_db(pid=29533): Terminated: ok {rc=0} 09:04:50.102855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29535): Launched 09:04:50.394476 run osmo-hlr_10.42.42.2(pid=29536): Launched 09:04:50.506477 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:51.012434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29538): Launched 09:04:51.302833 run osmo-stp_10.42.42.5(pid=29539): Launched 09:04:51.414085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:51.917893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29541): Launched 09:04:52.029705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:52.275491 run patchelf(pid=29542): Launched 09:04:52.437561 run osmo-stp_10.42.42.5(pid=29539): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29539)] 09:04:52.561269 run osmo-stp_10.42.42.5(pid=29539): stdout: | (launched: 2022-12-13_09:04:51.249927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:52.686553 run osmo-stp_10.42.42.5(pid=29539): stderr: | 20221213090451420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090451420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090451420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090451421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090451421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090451421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090451421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:52.812038 run osmo-stp_10.42.42.5(pid=29539): stdout: | (launched: 2022-12-13_09:04:51.249927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:52.932203 run osmo-stp_10.42.42.5(pid=29539): stderr: | 20221213090451420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090451420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090451420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090451421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090451421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090451421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090451421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:53.074445 run patchelf(pid=29542): Terminating (SIGINT) 09:04:53.239027 run patchelf(pid=29542): Terminated: ok {rc=0} 09:04:53.357631 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29539): Process ended prematurely: osmo-stp_10.42.42.5(pid=29539) [trial-2387↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29539)] [trial-2387↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 09:04:53.366448 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 09:04:53.392911 run osmo-hlr_10.42.42.2(pid=29536): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29536)] 09:04:53.441365 run osmo-hlr_10.42.42.2(pid=29536): stdout: | (launched: 2022-12-13_09:04:50.341111) 09:04:53.490795 run osmo-hlr_10.42.42.2(pid=29536): stderr: | 20221213090450513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090450513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090450513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090450513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090450513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090450513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090450525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090450533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090450534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090450534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:53.540670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29535): Terminating (SIGTERM) 09:04:53.580430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29538): Terminating (SIGTERM) 09:04:53.620208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29541): Terminating (SIGTERM) 09:04:53.660299 --- ParallelTerminationStrategy: PID 29535 died... 09:04:53.679655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29535): Terminated: ok {rc=0} 09:04:53.723855 --- ParallelTerminationStrategy: PID 29538 died... 09:04:53.742638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29538): Terminated: ok {rc=0} 09:04:53.786641 --- ParallelTerminationStrategy: PID 29541 died... 09:04:53.805477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29541): Terminated: ok {rc=0} 09:04:53.889969 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 09:04:55.203306 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:04:55.209694 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:04:55.244028 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:04:55.283792 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:04:55.373233 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:04:55.408252 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:04:55.447596 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:04:56.041953 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:04:56.093079 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.104424 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:04:56.155558 tst cs_paging_gprs_active.py: using LAC 32902 09:04:56.276020 tst cs_paging_gprs_active.py: using RAC 7 09:04:56.393114 tst cs_paging_gprs_active.py: using CellId 32902 09:04:56.510613 tst cs_paging_gprs_active.py: using BVCI 32903 09:04:56.620642 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.631828 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.642804 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.653527 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.664375 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.675366 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.686655 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.697591 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:56.708519 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:04:56.829887 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:04:56.946171 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:04:57.146899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:57.445425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Launched 09:04:57.703588 run iperf3-srv_10.42.42.10(pid=29548): Launched 09:04:57.815212 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:04:58.013935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:58.310945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Launched 09:04:58.568208 run iperf3-srv_10.42.42.10(pid=29550): Launched 09:04:58.680053 tst cs_paging_gprs_active.py:38: start network... 09:04:58.878469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:59.337658 run create_hlr_db(pid=29551): Launched 09:04:59.451781 bus /gobi_6: Setting Powered False 09:05:00.511879 run create_hlr_db(pid=29551): Terminated: ok {rc=0} 09:05:00.977904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29553): Launched 09:05:01.317719 run osmo-hlr_10.42.42.2(pid=29554): Launched 09:05:01.452904 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:02.207541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29559): Launched 09:05:02.525147 run osmo-stp_10.42.42.5(pid=29560): Launched 09:05:02.640263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:03.152550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29562): Launched 09:05:03.265953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:03.516777 run patchelf(pid=29563): Launched 09:05:03.681885 run osmo-stp_10.42.42.5(pid=29560): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29560)] 09:05:03.808353 run osmo-stp_10.42.42.5(pid=29560): stdout: | (launched: 2022-12-13_09:05:02.471385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:03.935908 run osmo-stp_10.42.42.5(pid=29560): stderr: | 20221213090502641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090502641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090502642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090502642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090502642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090502642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090502642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:04.063435 run osmo-stp_10.42.42.5(pid=29560): stdout: | (launched: 2022-12-13_09:05:02.471385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:04.185881 run osmo-stp_10.42.42.5(pid=29560): stderr: | 20221213090502641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090502641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090502642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090502642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090502642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090502642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090502642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:04.330729 run patchelf(pid=29563): Terminating (SIGINT) 09:05:04.497685 run patchelf(pid=29563): Terminated: ok {rc=0} 09:05:04.617879 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29560): Process ended prematurely: osmo-stp_10.42.42.5(pid=29560) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29560)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:05:04.627229 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:05:04.653911 run osmo-hlr_10.42.42.2(pid=29554): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29554)] 09:05:04.701666 run osmo-hlr_10.42.42.2(pid=29554): stdout: | (launched: 2022-12-13_09:05:01.244747) 09:05:04.750935 run osmo-hlr_10.42.42.2(pid=29554): stderr: | 20221213090501596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090501596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090501596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090501597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090501597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090501597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090501615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090501627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090501628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090501628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:04.800418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Terminating (SIGTERM) 09:05:04.840592 run iperf3-srv_10.42.42.10(pid=29548): Terminating (SIGTERM) 09:05:04.880450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Terminating (SIGTERM) 09:05:04.920529 run iperf3-srv_10.42.42.10(pid=29550): Terminating (SIGTERM) 09:05:04.960104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29553): Terminating (SIGTERM) 09:05:04.999890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29559): Terminating (SIGTERM) 09:05:05.039614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29562): Terminating (SIGTERM) 09:05:05.079595 --- ParallelTerminationStrategy: PID 29547 died... 09:05:05.099081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Terminated: ok {rc=0} 09:05:05.143021 --- ParallelTerminationStrategy: PID 29548 died... 09:05:05.161812 run iperf3-srv_10.42.42.10(pid=29548): Terminated {rc=256} 09:05:05.205569 --- ParallelTerminationStrategy: PID 29549 died... 09:05:05.224385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Terminated: ok {rc=0} 09:05:05.268291 --- ParallelTerminationStrategy: PID 29550 died... 09:05:05.287062 run iperf3-srv_10.42.42.10(pid=29550): Terminated {rc=256} 09:05:05.330740 --- ParallelTerminationStrategy: PID 29553 died... 09:05:05.349305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29553): Terminated: ok {rc=0} 09:05:05.392846 --- ParallelTerminationStrategy: PID 29559 died... 09:05:05.412024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29559): Terminated: ok {rc=0} 09:05:05.455636 --- ParallelTerminationStrategy: PID 29562 died... 09:05:05.474550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29562): Terminated: ok {rc=0} 09:05:05.560191 bus /gobi_0: Setting Powered False 09:05:06.659540 bus /gobi_0: Setting Powered False 09:05:07.772495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:05:08.918945 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:08.930378 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:05:08.983888 tst iperf3.py: using LAC 32903 09:05:09.100514 tst iperf3.py: using RAC 8 09:05:09.217186 tst iperf3.py: using CellId 32903 09:05:09.342489 tst iperf3.py: using BVCI 32904 09:05:09.457673 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.469258 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.480492 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.491685 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.503298 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.515163 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.526967 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.538795 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:09.550578 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:09.666669 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:05:09.864936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:10.161141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29564): Launched 09:05:10.417940 run iperf3-srv_10.42.42.10(pid=29565): Launched 09:05:10.529166 tst iperf3.py:8: start network... 09:05:10.727524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:11.185851 run create_hlr_db(pid=29566): Launched 09:05:11.315378 bus /gobi_6: Setting Powered False 09:05:12.378249 run create_hlr_db(pid=29566): Terminated: ok {rc=0} 09:05:12.817766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29568): Launched 09:05:13.133691 run osmo-hlr_10.42.42.2(pid=29569): Launched 09:05:13.254061 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:13.804473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29571): Launched 09:05:14.120466 run osmo-stp_10.42.42.5(pid=29572): Launched 09:05:14.240492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:14.786318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29574): Launched 09:05:14.906870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:15.174970 run patchelf(pid=29575): Launched 09:05:15.351137 run osmo-stp_10.42.42.5(pid=29572): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29572)] 09:05:15.485086 run osmo-stp_10.42.42.5(pid=29572): stdout: | (launched: 2022-12-13_09:05:14.063193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:15.621339 run osmo-stp_10.42.42.5(pid=29572): stderr: | 20221213090514255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090514255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090514255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090514256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090514258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090514258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090514258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:15.756941 run osmo-stp_10.42.42.5(pid=29572): stdout: | (launched: 2022-12-13_09:05:14.063193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:15.891708 run osmo-stp_10.42.42.5(pid=29572): stderr: | 20221213090514255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090514255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090514255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090514256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090514258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090514258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090514258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:16.067807 run patchelf(pid=29575): Terminating (SIGINT) 09:05:16.242950 run patchelf(pid=29575): Terminated: ok {rc=0} 09:05:16.368188 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29572): Process ended prematurely: osmo-stp_10.42.42.5(pid=29572) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29572)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 09:05:16.378908 tst iperf3.py:8: Test FAILED (7.5 sec) 09:05:16.408887 run osmo-hlr_10.42.42.2(pid=29569): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29569)] 09:05:16.460493 run osmo-hlr_10.42.42.2(pid=29569): stdout: | (launched: 2022-12-13_09:05:13.076534) 09:05:16.512102 run osmo-hlr_10.42.42.2(pid=29569): stderr: | 20221213090513273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090513273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090513273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090513273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090513273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090513273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090513286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090513294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090513294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090513294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:16.566492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29564): Terminating (SIGTERM) 09:05:16.609400 run iperf3-srv_10.42.42.10(pid=29565): Terminating (SIGTERM) 09:05:16.653642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29568): Terminating (SIGTERM) 09:05:16.696674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29571): Terminating (SIGTERM) 09:05:16.740495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29574): Terminating (SIGTERM) 09:05:16.785939 --- ParallelTerminationStrategy: PID 29564 died... 09:05:16.806945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29564): Terminated: ok {rc=0} 09:05:16.855320 --- ParallelTerminationStrategy: PID 29565 died... 09:05:16.875733 run iperf3-srv_10.42.42.10(pid=29565): Terminated {rc=256} 09:05:16.922079 --- ParallelTerminationStrategy: PID 29568 died... 09:05:16.942851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29568): Terminated: ok {rc=0} 09:05:16.990204 --- ParallelTerminationStrategy: PID 29571 died... 09:05:17.011012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29571): Terminated: ok {rc=0} 09:05:17.056817 --- ParallelTerminationStrategy: PID 29574 died... 09:05:17.077593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29574): Terminated: ok {rc=0} 09:05:17.167645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:05:18.312190 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.323790 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:05:18.374321 tst iperf3m4.py: using LAC 32904 09:05:18.502384 tst iperf3m4.py: using RAC 9 09:05:18.620201 tst iperf3m4.py: using CellId 32904 09:05:18.735463 tst iperf3m4.py: using BVCI 32905 09:05:18.851720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.863275 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.874557 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.885796 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.896910 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.908148 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.919577 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.930809 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:18.942285 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:19.059296 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:19.180543 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:19.297128 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:19.415694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:05:19.616653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:19.914834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29576): Launched 09:05:20.174010 run iperf3-srv_10.42.42.10(pid=29577): Launched 09:05:20.285739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:05:20.485264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:20.783291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29578): Launched 09:05:21.041283 run iperf3-srv_10.42.42.10(pid=29579): Launched 09:05:21.153068 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:05:21.352342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:21.650846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29580): Launched 09:05:21.908636 run iperf3-srv_10.42.42.10(pid=29581): Launched 09:05:22.020633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:05:22.220875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:22.519524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29582): Launched 09:05:22.777708 run iperf3-srv_10.42.42.10(pid=29583): Launched 09:05:22.889330 tst iperf3m4.py:8: start network... 09:05:23.088151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:23.547852 run create_hlr_db(pid=29584): Launched 09:05:23.662845 bus /gobi_6: Setting Powered False 09:05:24.722274 run create_hlr_db(pid=29584): Terminated: ok {rc=0} 09:05:25.136076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Launched 09:05:25.432199 run osmo-hlr_10.42.42.2(pid=29587): Launched 09:05:25.545894 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:26.075413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Launched 09:05:26.373285 run osmo-stp_10.42.42.5(pid=29590): Launched 09:05:26.487105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:26.998813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29592): Launched 09:05:27.112826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:27.363982 run patchelf(pid=29593): Launched 09:05:27.528731 run osmo-stp_10.42.42.5(pid=29590): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] 09:05:27.654962 run osmo-stp_10.42.42.5(pid=29590): stdout: | (launched: 2022-12-13_09:05:26.318838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:27.783032 run osmo-stp_10.42.42.5(pid=29590): stderr: | 20221213090526490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090526490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090526490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090526491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090526491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090526491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090526491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:27.910618 run osmo-stp_10.42.42.5(pid=29590): stdout: | (launched: 2022-12-13_09:05:26.318838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:28.032389 run osmo-stp_10.42.42.5(pid=29590): stderr: | 20221213090526490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090526490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090526490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090526491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090526491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090526491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090526491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:28.177132 run patchelf(pid=29593): Terminating (SIGINT) 09:05:28.344161 run patchelf(pid=29593): Terminated: ok {rc=0} 09:05:28.464691 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29590): Process ended prematurely: osmo-stp_10.42.42.5(pid=29590) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 09:05:28.474206 tst iperf3m4.py:8: Test FAILED (10.2 sec) 09:05:28.501315 run osmo-hlr_10.42.42.2(pid=29587): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29587)] 09:05:28.549252 run osmo-hlr_10.42.42.2(pid=29587): stdout: | (launched: 2022-12-13_09:05:25.378160) 09:05:28.598909 run osmo-hlr_10.42.42.2(pid=29587): stderr: | 20221213090525552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090525552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090525552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090525552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090525552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090525552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090525564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090525573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090525573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090525573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:28.648862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29576): Terminating (SIGTERM) 09:05:28.688767 run iperf3-srv_10.42.42.10(pid=29577): Terminating (SIGTERM) 09:05:28.728463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29578): Terminating (SIGTERM) 09:05:28.768166 run iperf3-srv_10.42.42.10(pid=29579): Terminating (SIGTERM) 09:05:28.807724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29580): Terminating (SIGTERM) 09:05:28.847403 run iperf3-srv_10.42.42.10(pid=29581): Terminating (SIGTERM) 09:05:28.886847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29582): Terminating (SIGTERM) 09:05:28.927092 run iperf3-srv_10.42.42.10(pid=29583): Terminating (SIGTERM) 09:05:28.966641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Terminating (SIGTERM) 09:05:29.006369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Terminating (SIGTERM) 09:05:29.045997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29592): Terminating (SIGTERM) 09:05:29.085868 --- ParallelTerminationStrategy: PID 29576 died... 09:05:29.105337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29576): Terminated: ok {rc=0} 09:05:29.149267 --- ParallelTerminationStrategy: PID 29577 died... 09:05:29.167934 run iperf3-srv_10.42.42.10(pid=29577): Terminated {rc=256} 09:05:29.211578 --- ParallelTerminationStrategy: PID 29578 died... 09:05:29.230286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29578): Terminated: ok {rc=0} 09:05:29.273907 --- ParallelTerminationStrategy: PID 29579 died... 09:05:29.292694 run iperf3-srv_10.42.42.10(pid=29579): Terminated {rc=256} 09:05:29.336071 --- ParallelTerminationStrategy: PID 29580 died... 09:05:29.354585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29580): Terminated: ok {rc=0} 09:05:29.397978 --- ParallelTerminationStrategy: PID 29581 died... 09:05:29.416516 run iperf3-srv_10.42.42.10(pid=29581): Terminated {rc=256} 09:05:29.459807 --- ParallelTerminationStrategy: PID 29582 died... 09:05:29.478527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29582): Terminated: ok {rc=0} 09:05:29.521836 --- ParallelTerminationStrategy: PID 29583 died... 09:05:29.541070 run iperf3-srv_10.42.42.10(pid=29583): Terminated {rc=256} 09:05:29.584417 --- ParallelTerminationStrategy: PID 29586 died... 09:05:29.603346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Terminated: ok {rc=0} 09:05:29.646923 --- ParallelTerminationStrategy: PID 29589 died... 09:05:29.665731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Terminated: ok {rc=0} 09:05:29.709801 --- ParallelTerminationStrategy: PID 29592 died... 09:05:29.728531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29592): Terminated: ok {rc=0} 09:05:29.814110 bus /gobi_4: Setting Powered False 09:05:30.919153 bus /gobi_4: Setting Powered False 09:05:32.041983 bus /gobi_1: Setting Powered False 09:05:33.136709 bus /gobi_1: Setting Powered False 09:05:34.247702 bus /gobi_0: Setting Powered False 09:05:35.341550 bus /gobi_0: Setting Powered False 09:05:36.454786 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 09:05:37.555404 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:37.567134 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:05:37.616678 tst ping.py: using LAC 32905 09:05:37.730335 tst ping.py: using RAC 10 09:05:37.849111 tst ping.py: using CellId 32905 09:05:37.971653 tst ping.py: using BVCI 32906 09:05:38.084716 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:38.096861 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:38.108646 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:38.119861 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:38.131038 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:38.142328 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:38.153740 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:38.165025 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:38.277486 tst ping.py:19: start network... 09:05:38.472571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:38.924215 run create_hlr_db(pid=29594): Launched 09:05:39.035630 bus /gobi_6: Setting Powered False 09:05:40.093909 run create_hlr_db(pid=29594): Terminated: ok {rc=0} 09:05:40.521238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29596): Launched 09:05:40.832563 run osmo-hlr_10.42.42.2(pid=29597): Launched 09:05:40.952154 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:41.492649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29599): Launched 09:05:41.804587 run osmo-stp_10.42.42.5(pid=29600): Launched 09:05:41.924080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:42.463343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29602): Launched 09:05:42.581926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:42.845402 run patchelf(pid=29603): Launched 09:05:43.018490 run osmo-stp_10.42.42.5(pid=29600): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29600)] 09:05:43.151084 run osmo-stp_10.42.42.5(pid=29600): stdout: | (launched: 2022-12-13_09:05:41.747795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:43.284466 run osmo-stp_10.42.42.5(pid=29600): stderr: | 20221213090541938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090541939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090541939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090541939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090541942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090541942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090541942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:43.418136 run osmo-stp_10.42.42.5(pid=29600): stdout: | (launched: 2022-12-13_09:05:41.747795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:43.546302 run osmo-stp_10.42.42.5(pid=29600): stderr: | 20221213090541938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090541939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090541939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090541939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090541942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090541942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090541942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:43.697948 run patchelf(pid=29603): Terminating (SIGINT) 09:05:43.873180 run patchelf(pid=29603): Terminated: ok {rc=0} 09:05:43.999050 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29600): Process ended prematurely: osmo-stp_10.42.42.5(pid=29600) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29600)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 09:05:44.008423 tst ping.py:22: Test FAILED (6.4 sec) 09:05:44.036322 run osmo-hlr_10.42.42.2(pid=29597): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29597)] 09:05:44.086351 run osmo-hlr_10.42.42.2(pid=29597): stdout: | (launched: 2022-12-13_09:05:40.776205) 09:05:44.139010 run osmo-hlr_10.42.42.2(pid=29597): stderr: | 20221213090540971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090540971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090540972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090540972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090540972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090540972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090540989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090540998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090540998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090540998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:44.191348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29596): Terminating (SIGTERM) 09:05:44.233179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29599): Terminating (SIGTERM) 09:05:44.274878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29602): Terminating (SIGTERM) 09:05:44.316708 --- ParallelTerminationStrategy: PID 29596 died... 09:05:44.336810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29596): Terminated: ok {rc=0} 09:05:44.383190 --- ParallelTerminationStrategy: PID 29599 died... 09:05:44.402799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29599): Terminated: ok {rc=0} 09:05:44.448937 --- ParallelTerminationStrategy: PID 29602 died... 09:05:44.468462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29602): Terminated: ok {rc=0} 09:05:44.555835 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:05:45.643458 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:45.655552 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:05:45.708778 tst ping_idle_ping.py: using LAC 32906 09:05:45.829670 tst ping_idle_ping.py: using RAC 11 09:05:45.959965 tst ping_idle_ping.py: using CellId 32906 09:05:46.088443 tst ping_idle_ping.py: using BVCI 32907 09:05:46.208052 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:46.220398 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:46.232343 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:46.244237 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:46.257244 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:46.269858 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:46.282727 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:46.295217 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:46.416858 tst ping_idle_ping.py:24: start network... 09:05:46.631856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:47.137698 run create_hlr_db(pid=29604): Launched 09:05:47.295941 bus /gobi_6: Setting Powered False 09:05:48.358217 run create_hlr_db(pid=29604): Terminated: ok {rc=0} 09:05:48.777656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29606): Launched 09:05:49.069224 run osmo-hlr_10.42.42.2(pid=29607): Launched 09:05:49.181426 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:49.683949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29609): Launched 09:05:49.975429 run osmo-stp_10.42.42.5(pid=29610): Launched 09:05:50.086690 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:50.591162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29612): Launched 09:05:50.703023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:50.949438 run patchelf(pid=29613): Launched 09:05:51.112530 run osmo-stp_10.42.42.5(pid=29610): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29610)] 09:05:51.236773 run osmo-stp_10.42.42.5(pid=29610): stdout: | (launched: 2022-12-13_09:05:49.922554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:51.362831 run osmo-stp_10.42.42.5(pid=29610): stderr: | 20221213090550090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090550091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090550091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090550091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090550093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090550094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090550094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:51.488306 run osmo-stp_10.42.42.5(pid=29610): stdout: | (launched: 2022-12-13_09:05:49.922554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:51.608712 run osmo-stp_10.42.42.5(pid=29610): stderr: | 20221213090550090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090550091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090550091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090550091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090550093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090550094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090550094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:51.751357 run patchelf(pid=29613): Terminating (SIGINT) 09:05:51.918265 run patchelf(pid=29613): Terminated: ok {rc=0} 09:05:52.036250 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29610): Process ended prematurely: osmo-stp_10.42.42.5(pid=29610) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29610)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 09:05:52.045147 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:05:52.071488 run osmo-hlr_10.42.42.2(pid=29607): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29607)] 09:05:52.119621 run osmo-hlr_10.42.42.2(pid=29607): stdout: | (launched: 2022-12-13_09:05:49.016097) 09:05:52.168754 run osmo-hlr_10.42.42.2(pid=29607): stderr: | 20221213090549193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090549193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090549193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090549193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090549193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090549193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090549225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090549235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090549235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090549235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:52.218076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29606): Terminating (SIGTERM) 09:05:52.257474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29609): Terminating (SIGTERM) 09:05:52.296739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29612): Terminating (SIGTERM) 09:05:52.336289 --- ParallelTerminationStrategy: PID 29606 died... 09:05:52.355558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29606): Terminated: ok {rc=0} 09:05:52.399441 --- ParallelTerminationStrategy: PID 29609 died... 09:05:52.418130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29609): Terminated: ok {rc=0} 09:05:52.462111 --- ParallelTerminationStrategy: PID 29612 died... 09:05:52.481031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29612): Terminated: ok {rc=0} 09:05:52.567121 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:05:53.887076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:53.893571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:05:53.927888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:05:53.967559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:05:54.054166 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:05:54.088106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:05:54.127498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:05:54.727062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:05:54.777785 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:54.789131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:05:54.863541 tst cs_paging_gprs_active.py: using LAC 32907 09:05:54.989198 tst cs_paging_gprs_active.py: using RAC 12 09:05:55.112716 tst cs_paging_gprs_active.py: using CellId 32907 09:05:55.238864 tst cs_paging_gprs_active.py: using BVCI 32908 09:05:55.355826 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.367196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.378474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.389702 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.400890 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.412082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.423410 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.434585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:55.445963 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:05:55.562768 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:05:55.680482 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:05:55.895210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:56.213932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29621): Launched 09:05:56.488936 run iperf3-srv_10.42.42.10(pid=29622): Launched 09:05:56.608509 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:05:56.823114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:57.142187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29623): Launched 09:05:57.417781 run iperf3-srv_10.42.42.10(pid=29624): Launched 09:05:57.537073 tst cs_paging_gprs_active.py:38: start network... 09:05:57.750785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:58.243220 run create_hlr_db(pid=29625): Launched 09:05:58.371502 bus /gobi_6: Setting Powered False 09:05:59.434008 run create_hlr_db(pid=29625): Terminated: ok {rc=0} 09:05:59.874284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29627): Launched 09:06:00.191030 run osmo-hlr_10.42.42.2(pid=29628): Launched 09:06:00.311920 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:00.857475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29630): Launched 09:06:01.182841 run osmo-stp_10.42.42.5(pid=29631): Launched 09:06:01.428106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:02.068533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29633): Launched 09:06:02.210211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:02.478515 run patchelf(pid=29634): Launched 09:06:02.654533 run osmo-stp_10.42.42.5(pid=29631): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29631)] 09:06:02.788251 run osmo-stp_10.42.42.5(pid=29631): stdout: | (launched: 2022-12-13_09:06:01.121483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:02.923927 run osmo-stp_10.42.42.5(pid=29631): stderr: | 20221213090601421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090601421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090601422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090601422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090601423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090601423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090601423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:03.059546 run osmo-stp_10.42.42.5(pid=29631): stdout: | (launched: 2022-12-13_09:06:01.121483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:03.191827 run osmo-stp_10.42.42.5(pid=29631): stderr: | 20221213090601421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090601421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090601422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090601422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090601423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090601423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090601423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:03.346050 run patchelf(pid=29634): Terminating (SIGINT) 09:06:03.523309 run patchelf(pid=29634): Terminated: ok {rc=0} 09:06:03.651481 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29631): Process ended prematurely: osmo-stp_10.42.42.5(pid=29631) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29631)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:06:03.661559 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 09:06:03.689537 run osmo-hlr_10.42.42.2(pid=29628): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29628)] 09:06:03.738951 run osmo-hlr_10.42.42.2(pid=29628): stdout: | (launched: 2022-12-13_09:06:00.133477) 09:06:03.790028 run osmo-hlr_10.42.42.2(pid=29628): stderr: | 20221213090600332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090600332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090600332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090600332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090600332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090600332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090600345 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090600353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090600353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090600354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:03.841524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29621): Terminating (SIGTERM) 09:06:03.882707 run iperf3-srv_10.42.42.10(pid=29622): Terminating (SIGTERM) 09:06:03.923684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29623): Terminating (SIGTERM) 09:06:03.965309 run iperf3-srv_10.42.42.10(pid=29624): Terminating (SIGTERM) 09:06:04.006534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29627): Terminating (SIGTERM) 09:06:04.047603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29630): Terminating (SIGTERM) 09:06:04.088735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29633): Terminating (SIGTERM) 09:06:04.130445 --- ParallelTerminationStrategy: PID 29621 died... 09:06:04.150276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29621): Terminated: ok {rc=0} 09:06:04.195826 --- ParallelTerminationStrategy: PID 29622 died... 09:06:04.215033 run iperf3-srv_10.42.42.10(pid=29622): Terminated {rc=256} 09:06:04.260276 --- ParallelTerminationStrategy: PID 29623 died... 09:06:04.279450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29623): Terminated: ok {rc=0} 09:06:04.324385 --- ParallelTerminationStrategy: PID 29624 died... 09:06:04.343550 run iperf3-srv_10.42.42.10(pid=29624): Terminated {rc=256} 09:06:04.388766 --- ParallelTerminationStrategy: PID 29627 died... 09:06:04.408097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29627): Terminated: ok {rc=0} 09:06:04.453474 --- ParallelTerminationStrategy: PID 29630 died... 09:06:04.473173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29630): Terminated: ok {rc=0} 09:06:04.518560 --- ParallelTerminationStrategy: PID 29633 died... 09:06:04.537750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29633): Terminated: ok {rc=0} 09:06:04.623604 bus /gobi_0: Setting Powered False 09:06:05.721473 bus /gobi_0: Setting Powered False 09:06:06.836437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:06:07.984753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:07.997320 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:06:08.072932 tst iperf3.py: using LAC 32908 09:06:08.199609 tst iperf3.py: using RAC 13 09:06:08.323462 tst iperf3.py: using CellId 32908 09:06:08.448172 tst iperf3.py: using BVCI 32909 09:06:08.565535 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.577009 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.588196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.599381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.611113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.622875 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.634713 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.646413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:08.658416 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:08.774197 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:06:08.974611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:09.272370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29635): Launched 09:06:09.530294 run iperf3-srv_10.42.42.10(pid=29636): Launched 09:06:09.642015 tst iperf3.py:8: start network... 09:06:09.841013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:10.301324 run create_hlr_db(pid=29637): Launched 09:06:10.416343 bus /gobi_6: Setting Powered False 09:06:11.476247 run create_hlr_db(pid=29637): Terminated: ok {rc=0} 09:06:11.890418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29639): Launched 09:06:12.188774 run osmo-hlr_10.42.42.2(pid=29640): Launched 09:06:12.302689 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:12.827285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29642): Launched 09:06:13.121410 run osmo-stp_10.42.42.5(pid=29643): Launched 09:06:13.234508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:13.744418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29645): Launched 09:06:13.858558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:14.109108 run patchelf(pid=29646): Launched 09:06:14.274678 run osmo-stp_10.42.42.5(pid=29643): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29643)] 09:06:14.401358 run osmo-stp_10.42.42.5(pid=29643): stdout: | (launched: 2022-12-13_09:06:13.067762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:14.529129 run osmo-stp_10.42.42.5(pid=29643): stderr: | 20221213090613236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090613236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090613236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090613237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090613239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090613239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090613239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:14.657183 run osmo-stp_10.42.42.5(pid=29643): stdout: | (launched: 2022-12-13_09:06:13.067762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:14.779638 run osmo-stp_10.42.42.5(pid=29643): stderr: | 20221213090613236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090613236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090613236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090613237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090613239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090613239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090613239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:14.924456 run patchelf(pid=29646): Terminating (SIGINT) 09:06:15.092132 run patchelf(pid=29646): Terminated: ok {rc=0} 09:06:15.213305 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29643): Process ended prematurely: osmo-stp_10.42.42.5(pid=29643) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29643)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 09:06:15.222745 tst iperf3.py:8: Test FAILED (7.3 sec) 09:06:15.249505 run osmo-hlr_10.42.42.2(pid=29640): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29640)] 09:06:15.297823 run osmo-hlr_10.42.42.2(pid=29640): stdout: | (launched: 2022-12-13_09:06:12.134165) 09:06:15.347547 run osmo-hlr_10.42.42.2(pid=29640): stderr: | 20221213090612308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090612308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090612308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090612308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090612308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090612308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090612320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090612328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090612329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090612329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:15.397804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29635): Terminating (SIGTERM) 09:06:15.437853 run iperf3-srv_10.42.42.10(pid=29636): Terminating (SIGTERM) 09:06:15.477733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29639): Terminating (SIGTERM) 09:06:15.517628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29642): Terminating (SIGTERM) 09:06:15.557637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29645): Terminating (SIGTERM) 09:06:15.597939 --- ParallelTerminationStrategy: PID 29635 died... 09:06:15.617663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29635): Terminated: ok {rc=0} 09:06:15.662193 --- ParallelTerminationStrategy: PID 29636 died... 09:06:15.681239 run iperf3-srv_10.42.42.10(pid=29636): Terminated {rc=256} 09:06:15.725203 --- ParallelTerminationStrategy: PID 29639 died... 09:06:15.744242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29639): Terminated: ok {rc=0} 09:06:15.788607 --- ParallelTerminationStrategy: PID 29642 died... 09:06:15.808419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29642): Terminated: ok {rc=0} 09:06:15.852557 --- ParallelTerminationStrategy: PID 29645 died... 09:06:15.878064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29645): Terminated: ok {rc=0} 09:06:15.979262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:06:17.131200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.143743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:06:17.218797 tst iperf3m4.py: using LAC 32909 09:06:17.347386 tst iperf3m4.py: using RAC 14 09:06:17.468423 tst iperf3m4.py: using CellId 32909 09:06:17.585867 tst iperf3m4.py: using BVCI 32910 09:06:17.695413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.706693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.717738 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.728508 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.740123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.751669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.763450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.774937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:17.786606 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:17.903999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:18.025662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:18.144154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:18.264429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:06:18.479587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:18.798261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29649): Launched 09:06:19.074461 run iperf3-srv_10.42.42.10(pid=29650): Launched 09:06:19.194441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:06:19.409293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:19.728347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29651): Launched 09:06:20.003821 run iperf3-srv_10.42.42.10(pid=29652): Launched 09:06:20.124216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:06:20.339284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:20.658504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29653): Launched 09:06:20.934770 run iperf3-srv_10.42.42.10(pid=29654): Launched 09:06:21.053995 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:06:21.269177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:21.588227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29655): Launched 09:06:21.863708 run iperf3-srv_10.42.42.10(pid=29656): Launched 09:06:22.004665 tst iperf3m4.py:8: start network... 09:06:22.205223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:22.665761 run create_hlr_db(pid=29657): Launched 09:06:22.779015 bus /gobi_6: Setting Powered False 09:06:23.838210 run create_hlr_db(pid=29657): Terminated: ok {rc=0} 09:06:24.274636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29659): Launched 09:06:24.592081 run osmo-hlr_10.42.42.2(pid=29660): Launched 09:06:24.713546 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:25.266889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29662): Launched 09:06:25.583482 run osmo-stp_10.42.42.5(pid=29663): Launched 09:06:25.704315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:26.252502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29665): Launched 09:06:26.373828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:26.641614 run patchelf(pid=29666): Launched 09:06:26.817734 run osmo-stp_10.42.42.5(pid=29663): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29663)] 09:06:26.951741 run osmo-stp_10.42.42.5(pid=29663): stdout: | (launched: 2022-12-13_09:06:25.525874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:27.087767 run osmo-stp_10.42.42.5(pid=29663): stderr: | 20221213090625719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090625719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090625720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090625720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090625721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090625721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090625721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:27.223908 run osmo-stp_10.42.42.5(pid=29663): stdout: | (launched: 2022-12-13_09:06:25.525874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:27.354394 run osmo-stp_10.42.42.5(pid=29663): stderr: | 20221213090625719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090625719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090625720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090625720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090625721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090625721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090625721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:27.508670 run patchelf(pid=29666): Terminating (SIGINT) 09:06:27.686216 run patchelf(pid=29666): Terminated: ok {rc=0} 09:06:27.814428 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29663): Process ended prematurely: osmo-stp_10.42.42.5(pid=29663) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29663)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:06:27.824541 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:06:27.853096 run osmo-hlr_10.42.42.2(pid=29660): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29660)] 09:06:27.902354 run osmo-hlr_10.42.42.2(pid=29660): stdout: | (launched: 2022-12-13_09:06:24.534428) 09:06:27.953449 run osmo-hlr_10.42.42.2(pid=29660): stderr: | 20221213090624732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090624732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090624732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090624732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090624732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090624732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090624746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090624755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090624755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090624755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:28.004853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29649): Terminating (SIGTERM) 09:06:28.046422 run iperf3-srv_10.42.42.10(pid=29650): Terminating (SIGTERM) 09:06:28.088619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29651): Terminating (SIGTERM) 09:06:28.130979 run iperf3-srv_10.42.42.10(pid=29652): Terminating (SIGTERM) 09:06:28.173233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29653): Terminating (SIGTERM) 09:06:28.215000 run iperf3-srv_10.42.42.10(pid=29654): Terminating (SIGTERM) 09:06:28.256669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29655): Terminating (SIGTERM) 09:06:28.298556 run iperf3-srv_10.42.42.10(pid=29656): Terminating (SIGTERM) 09:06:28.340512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29659): Terminating (SIGTERM) 09:06:28.382189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29662): Terminating (SIGTERM) 09:06:28.424006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29665): Terminating (SIGTERM) 09:06:28.466157 --- ParallelTerminationStrategy: PID 29649 died... 09:06:28.485969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29649): Terminated: ok {rc=0} 09:06:28.531534 --- ParallelTerminationStrategy: PID 29650 died... 09:06:28.550677 run iperf3-srv_10.42.42.10(pid=29650): Terminated {rc=256} 09:06:28.595790 --- ParallelTerminationStrategy: PID 29651 died... 09:06:28.614976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29651): Terminated: ok {rc=0} 09:06:28.660393 --- ParallelTerminationStrategy: PID 29652 died... 09:06:28.679538 run iperf3-srv_10.42.42.10(pid=29652): Terminated {rc=256} 09:06:28.724421 --- ParallelTerminationStrategy: PID 29653 died... 09:06:28.743769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29653): Terminated: ok {rc=0} 09:06:28.789430 --- ParallelTerminationStrategy: PID 29654 died... 09:06:28.808620 run iperf3-srv_10.42.42.10(pid=29654): Terminated {rc=256} 09:06:28.853867 --- ParallelTerminationStrategy: PID 29655 died... 09:06:28.873209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29655): Terminated: ok {rc=0} 09:06:28.918741 --- ParallelTerminationStrategy: PID 29656 died... 09:06:28.937973 run iperf3-srv_10.42.42.10(pid=29656): Terminated {rc=256} 09:06:28.982959 --- ParallelTerminationStrategy: PID 29659 died... 09:06:29.002277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29659): Terminated: ok {rc=0} 09:06:29.047571 --- ParallelTerminationStrategy: PID 29662 died... 09:06:29.066784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29662): Terminated: ok {rc=0} 09:06:29.112376 --- ParallelTerminationStrategy: PID 29665 died... 09:06:29.131742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29665): Terminated: ok {rc=0} 09:06:29.217530 bus /gobi_4: Setting Powered False 09:06:30.315135 bus /gobi_4: Setting Powered False 09:06:31.435781 bus /gobi_1: Setting Powered False 09:06:32.541452 bus /gobi_1: Setting Powered False 09:06:33.655572 bus /gobi_0: Setting Powered False 09:06:34.752740 bus /gobi_0: Setting Powered False 09:06:35.868683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:06:36.971288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:36.982809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:06:37.052695 tst ping.py: using LAC 32910 09:06:37.167636 tst ping.py: using RAC 15 09:06:37.281578 tst ping.py: using CellId 32910 09:06:37.406388 tst ping.py: using BVCI 32911 09:06:37.521442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:37.533335 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:37.544706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:37.556138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:37.568103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:37.580380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:37.592523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:37.604501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:37.720777 tst ping.py:19: start network... 09:06:37.916150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:38.365996 run create_hlr_db(pid=29667): Launched 09:06:38.477491 bus /gobi_6: Setting Powered False 09:06:39.536203 run create_hlr_db(pid=29667): Terminated: ok {rc=0} 09:06:39.961479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29669): Launched 09:06:40.272837 run osmo-hlr_10.42.42.2(pid=29670): Launched 09:06:40.393043 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:40.932265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29672): Launched 09:06:41.242580 run osmo-stp_10.42.42.5(pid=29673): Launched 09:06:41.361554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:41.899292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29675): Launched 09:06:42.017764 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:42.281280 run patchelf(pid=29676): Launched 09:06:42.453904 run osmo-stp_10.42.42.5(pid=29673): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29673)] 09:06:42.585533 run osmo-stp_10.42.42.5(pid=29673): stdout: | (launched: 2022-12-13_09:06:41.186292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:42.718625 run osmo-stp_10.42.42.5(pid=29673): stderr: | 20221213090641377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090641377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090641377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090641378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090641378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090641378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090641378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:42.852053 run osmo-stp_10.42.42.5(pid=29673): stdout: | (launched: 2022-12-13_09:06:41.186292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:42.979945 run osmo-stp_10.42.42.5(pid=29673): stderr: | 20221213090641377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090641377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090641377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090641378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090641378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090641378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090641378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:43.131856 run patchelf(pid=29676): Terminating (SIGINT) 09:06:43.306234 run patchelf(pid=29676): Terminated: ok {rc=0} 09:06:43.431943 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29673): Process ended prematurely: osmo-stp_10.42.42.5(pid=29673) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29673)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 09:06:43.441396 tst ping.py:22: Test FAILED (6.5 sec) 09:06:43.469012 run osmo-hlr_10.42.42.2(pid=29670): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29670)] 09:06:43.518528 run osmo-hlr_10.42.42.2(pid=29670): stdout: | (launched: 2022-12-13_09:06:40.216233) 09:06:43.569737 run osmo-hlr_10.42.42.2(pid=29670): stderr: | 20221213090640412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090640412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090640412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090640412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090640412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090640412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090640425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090640433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090640433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090640433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:43.621371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29669): Terminating (SIGTERM) 09:06:43.662334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29672): Terminating (SIGTERM) 09:06:43.703722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29675): Terminating (SIGTERM) 09:06:43.745885 --- ParallelTerminationStrategy: PID 29669 died... 09:06:43.765682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29669): Terminated: ok {rc=0} 09:06:43.811195 --- ParallelTerminationStrategy: PID 29672 died... 09:06:43.830513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29672): Terminated: ok {rc=0} 09:06:43.875733 --- ParallelTerminationStrategy: PID 29675 died... 09:06:43.894989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29675): Terminated: ok {rc=0} 09:06:43.980547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:06:45.066948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.079099 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:06:45.150648 tst ping_idle_ping.py: using LAC 32911 09:06:45.266432 tst ping_idle_ping.py: using RAC 16 09:06:45.380874 tst ping_idle_ping.py: using CellId 32911 09:06:45.495755 tst ping_idle_ping.py: using BVCI 32912 09:06:45.612034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.623829 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.635279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.646814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.658761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.670900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.682799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:45.694670 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:45.810220 tst ping_idle_ping.py:24: start network... 09:06:46.030068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:46.511467 run create_hlr_db(pid=29677): Launched 09:06:46.663665 bus /gobi_6: Setting Powered False 09:06:47.723450 run create_hlr_db(pid=29677): Terminated: ok {rc=0} 09:06:48.142178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29679): Launched 09:06:48.434650 run osmo-hlr_10.42.42.2(pid=29680): Launched 09:06:48.547220 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:49.062814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29682): Launched 09:06:49.354888 run osmo-stp_10.42.42.5(pid=29683): Launched 09:06:49.466758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:49.970952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29685): Launched 09:06:50.082252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:50.328339 run patchelf(pid=29686): Launched 09:06:50.490557 run osmo-stp_10.42.42.5(pid=29683): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29683)] 09:06:50.614816 run osmo-stp_10.42.42.5(pid=29683): stdout: | (launched: 2022-12-13_09:06:49.301627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:50.740602 run osmo-stp_10.42.42.5(pid=29683): stderr: | 20221213090649469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090649469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090649469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090649470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090649470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090649470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090649470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:50.866167 run osmo-stp_10.42.42.5(pid=29683): stdout: | (launched: 2022-12-13_09:06:49.301627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:50.986469 run osmo-stp_10.42.42.5(pid=29683): stderr: | 20221213090649469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090649469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090649469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090649470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090649470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090649470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090649470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:51.129276 run patchelf(pid=29686): Terminating (SIGINT) 09:06:51.293527 run patchelf(pid=29686): Terminated: ok {rc=0} 09:06:51.411695 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29683): Process ended prematurely: osmo-stp_10.42.42.5(pid=29683) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29683)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:06:51.420535 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:06:51.446532 run osmo-hlr_10.42.42.2(pid=29680): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29680)] 09:06:51.493858 run osmo-hlr_10.42.42.2(pid=29680): stdout: | (launched: 2022-12-13_09:06:48.381654) 09:06:51.542779 run osmo-hlr_10.42.42.2(pid=29680): stderr: | 20221213090648555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090648555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090648555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090648555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090648555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090648555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090648568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090648578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090648578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090648578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:51.591996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29679): Terminating (SIGTERM) 09:06:51.631490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29682): Terminating (SIGTERM) 09:06:51.671086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29685): Terminating (SIGTERM) 09:06:51.710795 --- ParallelTerminationStrategy: PID 29679 died... 09:06:51.730112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29679): Terminated: ok {rc=0} 09:06:51.773681 --- ParallelTerminationStrategy: PID 29682 died... 09:06:51.792407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29682): Terminated: ok {rc=0} 09:06:51.835732 --- ParallelTerminationStrategy: PID 29685 died... 09:06:51.854430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29685): Terminated: ok {rc=0} 09:06:51.936149 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:06:53.245324 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:06:53.252317 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:06:53.286974 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:06:53.326230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:06:53.415213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:06:53.449334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:06:53.487515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:06:54.087731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:06:54.139070 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.150469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:06:54.222712 tst cs_paging_gprs_active.py: using LAC 32912 09:06:54.348142 tst cs_paging_gprs_active.py: using RAC 17 09:06:54.473855 tst cs_paging_gprs_active.py: using CellId 32912 09:06:54.601110 tst cs_paging_gprs_active.py: using BVCI 32913 09:06:54.718021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.729476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.740762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.752073 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.763381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.774506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.785843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.797035 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:54.808364 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:06:54.928083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:06:55.045194 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:06:55.244883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:55.542732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29690): Launched 09:06:55.801555 run iperf3-srv_10.42.42.10(pid=29691): Launched 09:06:55.913539 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:06:56.113172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:56.412122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29692): Launched 09:06:56.670300 run iperf3-srv_10.42.42.10(pid=29693): Launched 09:06:56.782006 tst cs_paging_gprs_active.py:38: start network... 09:06:56.980936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:57.441466 run create_hlr_db(pid=29694): Launched 09:06:57.555487 bus /gobi_6: Setting Powered False 09:06:58.615025 run create_hlr_db(pid=29694): Terminated: ok {rc=0} 09:06:59.049082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29696): Launched 09:06:59.365928 run osmo-hlr_10.42.42.2(pid=29697): Launched 09:06:59.486835 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:00.036525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29699): Launched 09:07:00.354188 run osmo-stp_10.42.42.5(pid=29700): Launched 09:07:00.476077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:01.038790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29702): Launched 09:07:01.195684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:01.471323 run patchelf(pid=29703): Launched 09:07:01.661994 run osmo-stp_10.42.42.5(pid=29700): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29700)] 09:07:01.799089 run osmo-stp_10.42.42.5(pid=29700): stdout: | (launched: 2022-12-13_09:07:00.296938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:01.938620 run osmo-stp_10.42.42.5(pid=29700): stderr: | 20221213090700487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090700487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090700487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090700488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090700488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090700488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090700488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:02.076830 run osmo-stp_10.42.42.5(pid=29700): stdout: | (launched: 2022-12-13_09:07:00.296938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:02.210279 run osmo-stp_10.42.42.5(pid=29700): stderr: | 20221213090700487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090700487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090700487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090700488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090700488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090700488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090700488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:02.366837 run patchelf(pid=29703): Terminating (SIGINT) 09:07:02.545883 run patchelf(pid=29703): Terminated: ok {rc=0} 09:07:02.674414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29700): Process ended prematurely: osmo-stp_10.42.42.5(pid=29700) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29700)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:07:02.684355 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:07:02.712503 run osmo-hlr_10.42.42.2(pid=29697): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29697)] 09:07:02.762142 run osmo-hlr_10.42.42.2(pid=29697): stdout: | (launched: 2022-12-13_09:06:59.308712) 09:07:02.813614 run osmo-hlr_10.42.42.2(pid=29697): stderr: | 20221213090659506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090659506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090659506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090659507 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090659507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090659507 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090659518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090659526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090659527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090659527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:02.865684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29690): Terminating (SIGTERM) 09:07:02.907138 run iperf3-srv_10.42.42.10(pid=29691): Terminating (SIGTERM) 09:07:02.948538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29692): Terminating (SIGTERM) 09:07:02.990439 run iperf3-srv_10.42.42.10(pid=29693): Terminating (SIGTERM) 09:07:03.032208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29696): Terminating (SIGTERM) 09:07:03.074221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29699): Terminating (SIGTERM) 09:07:03.116341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29702): Terminating (SIGTERM) 09:07:03.158219 --- ParallelTerminationStrategy: PID 29690 died... 09:07:03.177946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29690): Terminated: ok {rc=0} 09:07:03.223743 --- ParallelTerminationStrategy: PID 29691 died... 09:07:03.242973 run iperf3-srv_10.42.42.10(pid=29691): Terminated {rc=256} 09:07:03.288251 --- ParallelTerminationStrategy: PID 29692 died... 09:07:03.307722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29692): Terminated: ok {rc=0} 09:07:03.353251 --- ParallelTerminationStrategy: PID 29693 died... 09:07:03.372577 run iperf3-srv_10.42.42.10(pid=29693): Terminated {rc=256} 09:07:03.417916 --- ParallelTerminationStrategy: PID 29696 died... 09:07:03.437343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29696): Terminated: ok {rc=0} 09:07:03.482842 --- ParallelTerminationStrategy: PID 29699 died... 09:07:03.502216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29699): Terminated: ok {rc=0} 09:07:03.547864 --- ParallelTerminationStrategy: PID 29702 died... 09:07:03.567270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29702): Terminated: ok {rc=0} 09:07:03.654620 bus /gobi_0: Setting Powered False 09:07:04.756932 bus /gobi_0: Setting Powered False 09:07:05.871993 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:07:07.018352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.030523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:07:07.110491 tst iperf3.py: using LAC 32913 09:07:07.235488 tst iperf3.py: using RAC 18 09:07:07.358291 tst iperf3.py: using CellId 32913 09:07:07.486327 tst iperf3.py: using BVCI 32914 09:07:07.597228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.608303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.619359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.630328 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.641707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.652812 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.664376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.675525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:07.686839 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:07.801254 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:07:08.001552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:08.300257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29704): Launched 09:07:08.559856 run iperf3-srv_10.42.42.10(pid=29705): Launched 09:07:08.672161 tst iperf3.py:8: start network... 09:07:08.872141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:09.330953 run create_hlr_db(pid=29706): Launched 09:07:09.443890 bus /gobi_6: Setting Powered False 09:07:10.502890 run create_hlr_db(pid=29706): Terminated: ok {rc=0} 09:07:10.935364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Launched 09:07:11.250921 run osmo-hlr_10.42.42.2(pid=29709): Launched 09:07:11.372135 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:11.921196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Launched 09:07:12.237483 run osmo-stp_10.42.42.5(pid=29712): Launched 09:07:12.358849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:12.905810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Launched 09:07:13.026614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:13.294707 run patchelf(pid=29715): Launched 09:07:13.470465 run osmo-stp_10.42.42.5(pid=29712): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] 09:07:13.604714 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-13_09:07:12.180307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:13.740572 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221213090712373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090712373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090712373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090712374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090712374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090712374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090712374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:13.876726 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-13_09:07:12.180307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:14.007228 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221213090712373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090712373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090712373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090712374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090712374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090712374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090712374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:14.162058 run patchelf(pid=29715): Terminating (SIGINT) 09:07:14.340083 run patchelf(pid=29715): Terminated: ok {rc=0} 09:07:14.468847 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 09:07:14.478925 tst iperf3.py:8: Test FAILED (7.5 sec) 09:07:14.507292 run osmo-hlr_10.42.42.2(pid=29709): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29709)] 09:07:14.557301 run osmo-hlr_10.42.42.2(pid=29709): stdout: | (launched: 2022-12-13_09:07:11.194050) 09:07:14.608871 run osmo-hlr_10.42.42.2(pid=29709): stderr: | 20221213090711390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090711390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090711390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090711390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090711390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090711390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090711403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090711411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090711412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090711412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:14.660900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29704): Terminating (SIGTERM) 09:07:14.702492 run iperf3-srv_10.42.42.10(pid=29705): Terminating (SIGTERM) 09:07:14.743982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminating (SIGTERM) 09:07:14.785664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminating (SIGTERM) 09:07:14.827520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminating (SIGTERM) 09:07:14.871953 --- ParallelTerminationStrategy: PID 29704 died... 09:07:14.891930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29704): Terminated: ok {rc=0} 09:07:14.938557 --- ParallelTerminationStrategy: PID 29705 died... 09:07:14.958050 run iperf3-srv_10.42.42.10(pid=29705): Terminated {rc=256} 09:07:15.004056 --- ParallelTerminationStrategy: PID 29708 died... 09:07:15.023690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminated: ok {rc=0} 09:07:15.069879 --- ParallelTerminationStrategy: PID 29711 died... 09:07:15.089655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminated: ok {rc=0} 09:07:15.135993 --- ParallelTerminationStrategy: PID 29714 died... 09:07:15.155624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminated: ok {rc=0} 09:07:15.242974 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:07:16.416134 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:16.433204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:07:16.520392 tst iperf3m4.py: using LAC 32914 09:07:16.675491 tst iperf3m4.py: using RAC 19 09:07:16.805985 tst iperf3m4.py: using CellId 32914 09:07:16.927785 tst iperf3m4.py: using BVCI 32915 09:07:17.074353 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.089031 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.109806 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.133500 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.156683 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.170854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.182973 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.194410 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:17.206586 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:17.326734 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:17.445222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:17.565468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:17.687843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:07:17.889598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:18.189152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29716): Launched 09:07:18.447148 run iperf3-srv_10.42.42.10(pid=29717): Launched 09:07:18.559692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:07:18.758711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:19.055447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29718): Launched 09:07:19.313687 run iperf3-srv_10.42.42.10(pid=29719): Launched 09:07:19.425524 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:07:19.624203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:19.922581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29720): Launched 09:07:20.181135 run iperf3-srv_10.42.42.10(pid=29721): Launched 09:07:20.293291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:07:20.492190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:20.790462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29722): Launched 09:07:21.048887 run iperf3-srv_10.42.42.10(pid=29723): Launched 09:07:21.160780 tst iperf3m4.py:8: start network... 09:07:21.359170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:21.818255 run create_hlr_db(pid=29724): Launched 09:07:21.932521 bus /gobi_6: Setting Powered False 09:07:22.992461 run create_hlr_db(pid=29724): Terminated: ok {rc=0} 09:07:23.405966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29726): Launched 09:07:23.702388 run osmo-hlr_10.42.42.2(pid=29727): Launched 09:07:23.815679 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:24.329403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29729): Launched 09:07:24.625267 run osmo-stp_10.42.42.5(pid=29730): Launched 09:07:24.738505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:25.249087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29732): Launched 09:07:25.371885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:25.639119 run patchelf(pid=29733): Launched 09:07:25.815212 run osmo-stp_10.42.42.5(pid=29730): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29730)] 09:07:25.949326 run osmo-stp_10.42.42.5(pid=29730): stdout: | (launched: 2022-12-13_09:07:24.571138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:26.085103 run osmo-stp_10.42.42.5(pid=29730): stderr: | 20221213090724741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090724741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090724741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090724742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090724742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090724742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090724742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:26.221451 run osmo-stp_10.42.42.5(pid=29730): stdout: | (launched: 2022-12-13_09:07:24.571138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:26.351300 run osmo-stp_10.42.42.5(pid=29730): stderr: | 20221213090724741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090724741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090724741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090724742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090724742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090724742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090724742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:26.506377 run patchelf(pid=29733): Terminating (SIGINT) 09:07:26.684833 run patchelf(pid=29733): Terminated: ok {rc=0} 09:07:26.813106 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29730): Process ended prematurely: osmo-stp_10.42.42.5(pid=29730) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29730)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:07:26.823526 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:07:26.852199 run osmo-hlr_10.42.42.2(pid=29727): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29727)] 09:07:26.901758 run osmo-hlr_10.42.42.2(pid=29727): stdout: | (launched: 2022-12-13_09:07:23.648170) 09:07:26.953289 run osmo-hlr_10.42.42.2(pid=29727): stderr: | 20221213090723823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090723823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090723823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090723823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090723823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090723823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090723838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090723848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090723848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090723848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:27.005231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29716): Terminating (SIGTERM) 09:07:27.046667 run iperf3-srv_10.42.42.10(pid=29717): Terminating (SIGTERM) 09:07:27.088191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29718): Terminating (SIGTERM) 09:07:27.129734 run iperf3-srv_10.42.42.10(pid=29719): Terminating (SIGTERM) 09:07:27.171623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29720): Terminating (SIGTERM) 09:07:27.213940 run iperf3-srv_10.42.42.10(pid=29721): Terminating (SIGTERM) 09:07:27.255710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29722): Terminating (SIGTERM) 09:07:27.297275 run iperf3-srv_10.42.42.10(pid=29723): Terminating (SIGTERM) 09:07:27.338731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29726): Terminating (SIGTERM) 09:07:27.380258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29729): Terminating (SIGTERM) 09:07:27.421760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29732): Terminating (SIGTERM) 09:07:27.463475 --- ParallelTerminationStrategy: PID 29716 died... 09:07:27.483617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29716): Terminated: ok {rc=0} 09:07:27.529666 --- ParallelTerminationStrategy: PID 29717 died... 09:07:27.548901 run iperf3-srv_10.42.42.10(pid=29717): Terminated {rc=256} 09:07:27.594708 --- ParallelTerminationStrategy: PID 29718 died... 09:07:27.614337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29718): Terminated: ok {rc=0} 09:07:27.660086 --- ParallelTerminationStrategy: PID 29719 died... 09:07:27.679665 run iperf3-srv_10.42.42.10(pid=29719): Terminated {rc=256} 09:07:27.725550 --- ParallelTerminationStrategy: PID 29720 died... 09:07:27.745126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29720): Terminated: ok {rc=0} 09:07:27.791170 --- ParallelTerminationStrategy: PID 29721 died... 09:07:27.810787 run iperf3-srv_10.42.42.10(pid=29721): Terminated {rc=256} 09:07:27.856670 --- ParallelTerminationStrategy: PID 29722 died... 09:07:27.876299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29722): Terminated: ok {rc=0} 09:07:27.922184 --- ParallelTerminationStrategy: PID 29723 died... 09:07:27.941607 run iperf3-srv_10.42.42.10(pid=29723): Terminated {rc=256} 09:07:27.987254 --- ParallelTerminationStrategy: PID 29726 died... 09:07:28.006859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29726): Terminated: ok {rc=0} 09:07:28.052439 --- ParallelTerminationStrategy: PID 29729 died... 09:07:28.071862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29729): Terminated: ok {rc=0} 09:07:28.117476 --- ParallelTerminationStrategy: PID 29732 died... 09:07:28.137127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29732): Terminated: ok {rc=0} 09:07:28.224743 bus /gobi_4: Setting Powered False 09:07:29.322066 bus /gobi_4: Setting Powered False 09:07:30.435612 bus /gobi_1: Setting Powered False 09:07:31.538564 bus /gobi_1: Setting Powered False 09:07:32.659014 bus /gobi_0: Setting Powered False 09:07:33.757101 bus /gobi_0: Setting Powered False 09:07:34.873618 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:07:35.975729 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:35.987425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:07:36.061331 tst ping.py: using LAC 32915 09:07:36.175167 tst ping.py: using RAC 20 09:07:36.290668 tst ping.py: using CellId 32915 09:07:36.413537 tst ping.py: using BVCI 32916 09:07:36.528583 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:36.540079 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:36.551696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:36.563091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:36.574288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:36.585562 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:36.596865 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:36.608103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:36.726727 tst ping.py:19: start network... 09:07:36.936291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:37.418501 run create_hlr_db(pid=29734): Launched 09:07:37.544673 bus /gobi_6: Setting Powered False 09:07:38.607209 run create_hlr_db(pid=29734): Terminated: ok {rc=0} 09:07:39.024826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29736): Launched 09:07:39.315833 run osmo-hlr_10.42.42.2(pid=29737): Launched 09:07:39.427174 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:39.950245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29739): Launched 09:07:40.262613 run osmo-stp_10.42.42.5(pid=29740): Launched 09:07:40.381369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:40.919209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29742): Launched 09:07:41.037977 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:41.300696 run patchelf(pid=29743): Launched 09:07:41.473649 run osmo-stp_10.42.42.5(pid=29740): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29740)] 09:07:41.606224 run osmo-stp_10.42.42.5(pid=29740): stdout: | (launched: 2022-12-13_09:07:40.206694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:41.740361 run osmo-stp_10.42.42.5(pid=29740): stderr: | 20221213090740397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090740398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090740398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090740398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090740399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090740399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090740399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:41.874658 run osmo-stp_10.42.42.5(pid=29740): stdout: | (launched: 2022-12-13_09:07:40.206694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:42.003752 run osmo-stp_10.42.42.5(pid=29740): stderr: | 20221213090740397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090740398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090740398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090740398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090740399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090740399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090740399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:42.156098 run patchelf(pid=29743): Terminating (SIGINT) 09:07:42.331463 run patchelf(pid=29743): Terminated: ok {rc=0} 09:07:42.458054 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29740): Process ended prematurely: osmo-stp_10.42.42.5(pid=29740) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29740)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 09:07:42.467673 tst ping.py:22: Test FAILED (6.5 sec) 09:07:42.495797 run osmo-hlr_10.42.42.2(pid=29737): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29737)] 09:07:42.546066 run osmo-hlr_10.42.42.2(pid=29737): stdout: | (launched: 2022-12-13_09:07:39.262973) 09:07:42.597890 run osmo-hlr_10.42.42.2(pid=29737): stderr: | 20221213090739437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090739437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090739437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090739437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090739437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090739437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090739450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090739458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090739458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090739458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:42.649609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29736): Terminating (SIGTERM) 09:07:42.691649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29739): Terminating (SIGTERM) 09:07:42.733473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29742): Terminating (SIGTERM) 09:07:42.775935 --- ParallelTerminationStrategy: PID 29736 died... 09:07:42.796185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29736): Terminated: ok {rc=0} 09:07:42.842553 --- ParallelTerminationStrategy: PID 29739 died... 09:07:42.862351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29739): Terminated: ok {rc=0} 09:07:42.908595 --- ParallelTerminationStrategy: PID 29742 died... 09:07:42.928239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29742): Terminated: ok {rc=0} 09:07:43.016180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:07:44.101364 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.113441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:07:44.184695 tst ping_idle_ping.py: using LAC 32916 09:07:44.300879 tst ping_idle_ping.py: using RAC 21 09:07:44.414569 tst ping_idle_ping.py: using CellId 32916 09:07:44.528765 tst ping_idle_ping.py: using BVCI 32917 09:07:44.634597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.645621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.656376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.667141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.678089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.689289 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.700285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:44.711534 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:44.826070 tst ping_idle_ping.py:24: start network... 09:07:45.022181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:45.477612 run create_hlr_db(pid=29744): Launched 09:07:45.589252 bus /gobi_6: Setting Powered False 09:07:46.649389 run create_hlr_db(pid=29744): Terminated: ok {rc=0} 09:07:47.075526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29746): Launched 09:07:47.419272 run osmo-hlr_10.42.42.2(pid=29747): Launched 09:07:47.538881 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:48.075693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29749): Launched 09:07:48.387576 run osmo-stp_10.42.42.5(pid=29750): Launched 09:07:48.504922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:49.012681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29752): Launched 09:07:49.126071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:49.372456 run patchelf(pid=29753): Launched 09:07:49.535433 run osmo-stp_10.42.42.5(pid=29750): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29750)] 09:07:49.659968 run osmo-stp_10.42.42.5(pid=29750): stdout: | (launched: 2022-12-13_09:07:48.331257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:49.786181 run osmo-stp_10.42.42.5(pid=29750): stderr: | 20221213090748500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090748500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090748500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090748501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090748501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090748501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090748501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:49.912574 run osmo-stp_10.42.42.5(pid=29750): stdout: | (launched: 2022-12-13_09:07:48.331257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:50.033443 run osmo-stp_10.42.42.5(pid=29750): stderr: | 20221213090748500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090748500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090748500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090748501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090748501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090748501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090748501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:50.176921 run patchelf(pid=29753): Terminating (SIGINT) 09:07:50.341671 run patchelf(pid=29753): Terminated: ok {rc=0} 09:07:50.460340 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29750): Process ended prematurely: osmo-stp_10.42.42.5(pid=29750) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29750)] [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:07:50.469311 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:07:50.495432 run osmo-hlr_10.42.42.2(pid=29747): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29747)] 09:07:50.543783 run osmo-hlr_10.42.42.2(pid=29747): stdout: | (launched: 2022-12-13_09:07:47.363144) 09:07:50.592916 run osmo-hlr_10.42.42.2(pid=29747): stderr: | 20221213090747559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090747559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090747559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090747559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090747559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090747559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090747574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090747583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090747583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090747583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:50.642451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29746): Terminating (SIGTERM) 09:07:50.682228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29749): Terminating (SIGTERM) 09:07:50.722065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29752): Terminating (SIGTERM) 09:07:50.761975 --- ParallelTerminationStrategy: PID 29746 died... 09:07:50.781395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29746): Terminated: ok {rc=0} 09:07:50.826034 --- ParallelTerminationStrategy: PID 29749 died... 09:07:50.845107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29749): Terminated: ok {rc=0} 09:07:50.889148 --- ParallelTerminationStrategy: PID 29752 died... 09:07:50.907912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29752): Terminated: ok {rc=0} 09:07:50.993016 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:07:52.298459 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:52.304872 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:07:52.337727 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:07:52.372732 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:07:52.424278 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:07:52.457272 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:07:52.491301 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:07:53.056265 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:07:53.061762 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.073409 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:07:53.145818 tst switch_tch_pdch.py: using LAC 32917 09:07:53.269699 tst switch_tch_pdch.py: using RAC 22 09:07:53.391548 tst switch_tch_pdch.py: using CellId 32917 09:07:53.515842 tst switch_tch_pdch.py: using BVCI 32918 09:07:53.630176 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.641863 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.653425 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.664865 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.676441 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.687919 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.699547 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:53.711039 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:07:53.826546 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:07:53.944636 tst switch_tch_pdch.py:51: start network... 09:07:54.154030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:54.636010 run create_hlr_db(pid=29758): Launched 09:07:54.762653 bus /gobi_6: Setting Powered False 09:07:55.825494 run create_hlr_db(pid=29758): Terminated: ok {rc=0} 09:07:56.242663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29760): Launched 09:07:56.533698 run osmo-hlr_10.42.42.2(pid=29761): Launched 09:07:56.644496 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:57.145500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29763): Launched 09:07:57.436035 run osmo-stp_10.42.42.5(pid=29764): Launched 09:07:57.548805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:58.050683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29766): Launched 09:07:58.161506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:58.406448 run patchelf(pid=29767): Launched 09:07:58.567433 run osmo-stp_10.42.42.5(pid=29764): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29764)] 09:07:58.690593 run osmo-stp_10.42.42.5(pid=29764): stdout: | (launched: 2022-12-13_09:07:57.383360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:58.815807 run osmo-stp_10.42.42.5(pid=29764): stderr: | 20221213090757552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090757552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090757552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090757553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090757553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090757553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090757553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:58.941652 run osmo-stp_10.42.42.5(pid=29764): stdout: | (launched: 2022-12-13_09:07:57.383360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:59.061091 run osmo-stp_10.42.42.5(pid=29764): stderr: | 20221213090757552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090757552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090757552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090757553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090757553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090757553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090757553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:59.202328 run patchelf(pid=29767): Terminating (SIGINT) 09:07:59.365329 run patchelf(pid=29767): Terminated: ok {rc=0} 09:07:59.482530 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29764): Process ended prematurely: osmo-stp_10.42.42.5(pid=29764) [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29764)] [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:07:59.491268 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 09:07:59.517648 run osmo-hlr_10.42.42.2(pid=29761): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29761)] 09:07:59.565211 run osmo-hlr_10.42.42.2(pid=29761): stdout: | (launched: 2022-12-13_09:07:56.481052) 09:07:59.614268 run osmo-hlr_10.42.42.2(pid=29761): stderr: | 20221213090756656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090756656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090756656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090756656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090756656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090756656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090756669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090756677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090756677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090756677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:59.663454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29760): Terminating (SIGTERM) 09:07:59.702870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29763): Terminating (SIGTERM) 09:07:59.742254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29766): Terminating (SIGTERM) 09:07:59.782095 --- ParallelTerminationStrategy: PID 29760 died... 09:07:59.801190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29760): Terminated: ok {rc=0} 09:07:59.844928 --- ParallelTerminationStrategy: PID 29763 died... 09:07:59.863691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29763): Terminated: ok {rc=0} 09:07:59.907389 --- ParallelTerminationStrategy: PID 29766 died... 09:07:59.926016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29766): Terminated: ok {rc=0} 09:08:00.009226 bus /gobi_0: Setting Powered False 09:08:01.103360 bus /gobi_0: Setting Powered False 09:08:02.224690 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:08:03.476256 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:03.482133 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:08:03.515017 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:08:03.549695 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:08:03.603325 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:08:03.638887 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:08:03.674276 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:08:04.225272 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:08:04.230279 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.241450 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:08:04.313342 tst switch_tch_pdch.py: using LAC 32918 09:08:04.429821 tst switch_tch_pdch.py: using RAC 23 09:08:04.547722 tst switch_tch_pdch.py: using CellId 32918 09:08:04.672321 tst switch_tch_pdch.py: using BVCI 32919 09:08:04.779447 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.790650 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.801797 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.812675 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.823763 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.834860 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.846114 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:08:04.857125 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:08:04.975457 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:08:05.091001 tst switch_tch_pdch.py:51: start network... 09:08:05.286033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:05.711696 run create_hlr_db(pid=29773): Launched 09:08:05.822877 bus /gobi_6: Setting Powered False 09:08:06.882069 run create_hlr_db(pid=29773): Terminated: ok {rc=0} 09:08:07.283126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29775): Launched 09:08:07.594275 run osmo-hlr_10.42.42.2(pid=29776): Launched 09:08:07.714192 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:08.223345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29778): Launched 09:08:08.532627 run osmo-stp_10.42.42.5(pid=29779): Launched 09:08:08.651216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:08:09.163421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29781): Launched 09:08:09.282683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:08:09.544920 run patchelf(pid=29782): Launched 09:08:09.717999 run osmo-stp_10.42.42.5(pid=29779): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29779)] 09:08:09.849931 run osmo-stp_10.42.42.5(pid=29779): stdout: | (launched: 2022-12-13_09:08:08.476376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:09.983514 run osmo-stp_10.42.42.5(pid=29779): stderr: | 20221213090808667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090808667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090808667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090808668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090808668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090808668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090808668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:10.116742 run osmo-stp_10.42.42.5(pid=29779): stdout: | (launched: 2022-12-13_09:08:08.476376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:10.245193 run osmo-stp_10.42.42.5(pid=29779): stderr: | 20221213090808667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090808667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090808667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090808668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090808668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090808668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090808668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:10.396874 run patchelf(pid=29782): Terminating (SIGINT) 09:08:10.571416 run patchelf(pid=29782): Terminated: ok {rc=0} 09:08:10.697333 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29779): Process ended prematurely: osmo-stp_10.42.42.5(pid=29779) [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29779)] [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:08:10.706703 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 09:08:10.734108 run osmo-hlr_10.42.42.2(pid=29776): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29776)] 09:08:10.783429 run osmo-hlr_10.42.42.2(pid=29776): stdout: | (launched: 2022-12-13_09:08:07.538067) 09:08:10.834488 run osmo-hlr_10.42.42.2(pid=29776): stderr: | 20221213090807735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090807735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090807735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090807735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090807735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090807735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090807750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090807759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090807759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090807759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:10.886007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29775): Terminating (SIGTERM) 09:08:10.927432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29778): Terminating (SIGTERM) 09:08:10.969141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29781): Terminating (SIGTERM) 09:08:11.011025 --- ParallelTerminationStrategy: PID 29775 died... 09:08:11.031191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29775): Terminated: ok {rc=0} 09:08:11.077211 --- ParallelTerminationStrategy: PID 29778 died... 09:08:11.096766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29778): Terminated: ok {rc=0} 09:08:11.142239 --- ParallelTerminationStrategy: PID 29781 died... 09:08:11.161724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29781): Terminated: ok {rc=0} 09:08:11.249343 bus /gobi_0: Setting Powered False 09:08:12.344336 bus /gobi_0: Setting Powered False 09:08:13.458482 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_sms:trx-umtrx --------------------------------------------------------------------- 09:08:14.710048 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:14.714619 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:08:14.747272 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 09:08:14.754407 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 09:08:14.807279 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:08:14.840495 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 09:08:14.847378 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 09:08:15.384120 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 09:08:15.389225 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 09:08:15.399935 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 09:08:15.447193 tst mo_mt_sms.py: using LAC 32919 09:08:15.561351 tst mo_mt_sms.py: using RAC 24 09:08:15.687419 tst mo_mt_sms.py: using CellId 32919 09:08:15.818607 tst mo_mt_sms.py: using BVCI 32920 09:08:15.968371 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:08:16.118336 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:08:16.233214 tst mo_mt_sms.py:9: start nitb and bts... 09:08:16.435758 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:08:17.051698 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29786): Launched 09:08:17.361708 run osmo-nitb_10.42.42.2(pid=29787): Launched 09:08:17.535359 run osmo-nitb_10.42.42.2(pid=29787): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29787)] 09:08:17.675830 run osmo-nitb_10.42.42.2(pid=29787): stdout: | (launched: 2022-12-13_09:08:17.305191) 09:08:17.818317 run osmo-nitb_10.42.42.2(pid=29787): stderr: | (launched: 2022-12-13_09:08:17.348692) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:08:17.960686 run osmo-nitb_10.42.42.2(pid=29787): stdout: | (launched: 2022-12-13_09:08:17.305191) 09:08:18.097586 run osmo-nitb_10.42.42.2(pid=29787): stderr: | (launched: 2022-12-13_09:08:17.348692) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29787): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29787) [trial-2387↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29787)] 09:08:18.480388 tst osmo-nitb_10.42.42.2(pid=29787): stdout: | (launched: 2022-12-13_09:08:17.305191) 09:08:18.606557 tst osmo-nitb_10.42.42.2(pid=29787): stderr: | (launched: 2022-12-13_09:08:17.348692) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:08:18.755436 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29787): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29787) [trial-2387↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29787)] [trial-2387↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 09:08:18.764558 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:08:18.771695 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29786): Terminating (SIGTERM) 09:08:18.982277 --- ParallelTerminationStrategy: PID 29786 died... 09:08:19.003968 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29786): Terminated: ok {rc=0} 09:08:19.093379 bus /sierra_3: Setting Powered False 09:08:20.192501 bus /sierra_3: Setting Powered False 09:08:21.309512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:trx-umtrx --------------------------------------------------------------------- 09:08:22.507511 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:22.511429 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:08:22.542928 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:08:22.570649 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 09:08:22.622926 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:08:22.655396 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:08:22.681838 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 09:08:23.225615 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 09:08:23.231593 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:23.242746 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 09:08:23.290930 tst mo_mt_sms.py: using LAC 32920 09:08:23.415836 tst mo_mt_sms.py: using RAC 25 09:08:23.538358 tst mo_mt_sms.py: using CellId 32920 09:08:23.662539 tst mo_mt_sms.py: using BVCI 32921 09:08:23.776492 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:23.787499 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:23.798284 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:23.808891 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:23.819627 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:23.830906 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:08:23.946884 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:08:24.060248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:24.511248 run create_hlr_db(pid=29791): Launched 09:08:24.623370 bus /sierra_2: Setting Powered False 09:08:25.681848 run create_hlr_db(pid=29791): Terminated: ok {rc=0} 09:08:26.107190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29793): Launched 09:08:26.417079 run osmo-hlr_10.42.42.2(pid=29794): Launched 09:08:26.536025 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:27.074493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29796): Launched 09:08:27.386614 run osmo-stp_10.42.42.5(pid=29797): Launched 09:08:27.505247 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:28.067392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29799): Launched 09:08:28.377819 run osmo-msc_10.42.42.6(pid=29800): Launched 09:08:28.551759 run osmo-stp_10.42.42.5(pid=29797): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29797)] 09:08:28.683119 run osmo-stp_10.42.42.5(pid=29797): stdout: | (launched: 2022-12-13_09:08:27.330423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:28.815355 run osmo-stp_10.42.42.5(pid=29797): stderr: | 20221213090827522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090827522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090827523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090827523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090827523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090827523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090827524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:28.946973 run osmo-stp_10.42.42.5(pid=29797): stdout: | (launched: 2022-12-13_09:08:27.330423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:29.071734 run osmo-stp_10.42.42.5(pid=29797): stderr: | 20221213090827522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090827522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090827523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090827523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090827523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090827523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090827524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:29.221366 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29797): Process ended prematurely: osmo-stp_10.42.42.5(pid=29797) [trial-2387↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29797)] [trial-2387↪sms:trx-umtrx↪mo_mt_sms.py:16] 09:08:29.230514 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 09:08:29.257615 run osmo-hlr_10.42.42.2(pid=29794): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29794)] 09:08:29.307465 run osmo-hlr_10.42.42.2(pid=29794): stdout: | (launched: 2022-12-13_09:08:26.361052) 09:08:29.358887 run osmo-hlr_10.42.42.2(pid=29794): stderr: | 20221213090826559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090826559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090826559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090826559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090826559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090826559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090826570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090826579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090826579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090826580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:29.430607 run osmo-msc_10.42.42.6(pid=29800): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29800)] 09:08:29.480019 run osmo-msc_10.42.42.6(pid=29800): stdout: | (launched: 2022-12-13_09:08:28.321625) 09:08:29.531367 run osmo-msc_10.42.42.6(pid=29800): stderr: | 20221213090828641 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090828641 DLGLOBAL DEBUG validating counter group 0x7f6876ef2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090828641 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090828641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090828642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090828642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090828643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090828644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090828644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090828644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:29.582722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29793): Terminating (SIGTERM) 09:08:29.623815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29796): Terminating (SIGTERM) 09:08:29.665058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29799): Terminating (SIGTERM) 09:08:29.706643 --- ParallelTerminationStrategy: PID 29793 died... 09:08:29.726460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29793): Terminated: ok {rc=0} 09:08:29.772056 --- ParallelTerminationStrategy: PID 29796 died... 09:08:29.791448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29796): Terminated: ok {rc=0} 09:08:29.837081 --- ParallelTerminationStrategy: PID 29799 died... 09:08:29.856428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29799): Terminated: ok {rc=0} 09:08:29.942828 bus /sierra_3: Setting Powered False 09:08:31.047754 bus /sierra_3: Setting Powered False 09:08:32.179002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 09:08:33.402474 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:33.407041 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:08:33.440061 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 09:08:33.447016 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 09:08:33.482294 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:08:33.515996 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 09:08:33.522965 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 09:08:34.042645 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 09:08:34.048064 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 09:08:34.059137 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 09:08:34.106862 tst assert_extension.py: using LAC 32921 09:08:34.230406 tst assert_extension.py: using RAC 26 09:08:34.352196 tst assert_extension.py: using CellId 32921 09:08:34.467676 tst assert_extension.py: using BVCI 32922 09:08:34.573555 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 09:08:34.690639 tst assert_extension.py:10: start nitb and bts... 09:08:34.899722 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:08:35.536496 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29805): Launched 09:08:35.846718 run osmo-nitb_10.42.42.2(pid=29806): Launched 09:08:36.018440 run osmo-nitb_10.42.42.2(pid=29806): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29806)] 09:08:36.158079 run osmo-nitb_10.42.42.2(pid=29806): stdout: | (launched: 2022-12-13_09:08:35.790598) 09:08:36.300189 run osmo-nitb_10.42.42.2(pid=29806): stderr: | (launched: 2022-12-13_09:08:35.836926) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:08:36.441705 run osmo-nitb_10.42.42.2(pid=29806): stdout: | (launched: 2022-12-13_09:08:35.790598) 09:08:36.577500 run osmo-nitb_10.42.42.2(pid=29806): stderr: | (launched: 2022-12-13_09:08:35.836926) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29806): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29806) [trial-2387↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29806)] 09:08:36.963193 tst osmo-nitb_10.42.42.2(pid=29806): stdout: | (launched: 2022-12-13_09:08:35.790598) 09:08:37.089538 tst osmo-nitb_10.42.42.2(pid=29806): stderr: | (launched: 2022-12-13_09:08:35.836926) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:08:37.239151 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29806): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29806) [trial-2387↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29806)] [trial-2387↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 09:08:37.248210 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:08:37.255398 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29805): Terminating (SIGTERM) 09:08:37.465376 --- ParallelTerminationStrategy: PID 29805 died... 09:08:37.486567 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29805): Terminated: ok {rc=0} 09:08:37.574490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:trx-umtrx --------------------------------------------------------------------- 09:08:38.751418 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:38.755832 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:08:38.788759 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:08:38.817530 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 09:08:38.853918 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:08:38.887060 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:08:38.914476 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 09:08:39.443254 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 09:08:39.448604 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:39.459720 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 09:08:39.507444 tst assert_extension.py: using LAC 32922 09:08:39.630243 tst assert_extension.py: using RAC 27 09:08:39.753385 tst assert_extension.py: using CellId 32922 09:08:39.875832 tst assert_extension.py: using BVCI 32923 09:08:39.989112 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:40.000317 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:40.011511 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:40.023038 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:40.034551 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:08:40.046075 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 09:08:40.166124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:40.649514 run create_hlr_db(pid=29810): Launched 09:08:40.776853 bus /sierra_2: Setting Powered False 09:08:41.838856 run create_hlr_db(pid=29810): Terminated: ok {rc=0} 09:08:42.274454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29812): Launched 09:08:42.585567 run osmo-hlr_10.42.42.2(pid=29813): Launched 09:08:42.704937 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:43.247841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29815): Launched 09:08:43.558669 run osmo-stp_10.42.42.5(pid=29816): Launched 09:08:43.676691 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:44.239411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29818): Launched 09:08:44.548804 run osmo-msc_10.42.42.6(pid=29819): Launched 09:08:44.722586 run osmo-stp_10.42.42.5(pid=29816): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29816)] 09:08:44.854232 run osmo-stp_10.42.42.5(pid=29816): stdout: | (launched: 2022-12-13_09:08:43.502591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:44.986453 run osmo-stp_10.42.42.5(pid=29816): stderr: | 20221213090843693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090843694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090843694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090843694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090843696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090843697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090843697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:45.118022 run osmo-stp_10.42.42.5(pid=29816): stdout: | (launched: 2022-12-13_09:08:43.502591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:45.243806 run osmo-stp_10.42.42.5(pid=29816): stderr: | 20221213090843693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090843694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090843694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090843694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090843696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090843697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090843697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:45.392921 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29816): Process ended prematurely: osmo-stp_10.42.42.5(pid=29816) [trial-2387↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29816)] [trial-2387↪ussd:trx-umtrx↪assert_extension.py:17] 09:08:45.401938 tst assert_extension.py:17: Test FAILED (5.9 sec) 09:08:45.429245 run osmo-hlr_10.42.42.2(pid=29813): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29813)] 09:08:45.479777 run osmo-hlr_10.42.42.2(pid=29813): stdout: | (launched: 2022-12-13_09:08:42.529092) 09:08:45.531560 run osmo-hlr_10.42.42.2(pid=29813): stderr: | 20221213090842730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090842730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090842730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090842730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090842730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090842730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090842742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090842751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090842751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090842751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:45.603479 run osmo-msc_10.42.42.6(pid=29819): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29819)] 09:08:45.653251 run osmo-msc_10.42.42.6(pid=29819): stdout: | (launched: 2022-12-13_09:08:44.492656) 09:08:45.704699 run osmo-msc_10.42.42.6(pid=29819): stderr: | 20221213090844815 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090844815 DLGLOBAL DEBUG validating counter group 0x7fca14373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090844815 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090844815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090844815 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090844816 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090844817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090844818 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090844818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090844818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:45.756522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29812): Terminating (SIGTERM) 09:08:45.798071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29815): Terminating (SIGTERM) 09:08:45.839734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29818): Terminating (SIGTERM) 09:08:45.882433 --- ParallelTerminationStrategy: PID 29812 died... 09:08:45.902659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29812): Terminated: ok {rc=0} 09:08:45.961248 --- ParallelTerminationStrategy: PID 29815 died... 09:08:45.981475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29815): Terminated: ok {rc=0} 09:08:46.028656 --- ParallelTerminationStrategy: PID 29818 died... 09:08:46.048925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29818): Terminated: ok {rc=0} 09:08:46.138040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:08:47.383537 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:47.395519 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:08:47.444059 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:08:47.489978 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:08:47.549687 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:08:47.604907 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:08:47.642337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:08:48.207898 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:08:48.271882 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:48.284317 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:08:48.362360 tst mo_mt_call.py: using LAC 32923 09:08:48.511189 tst mo_mt_call.py: using RAC 28 09:08:48.680682 tst mo_mt_call.py: using CellId 32923 09:08:48.832361 tst mo_mt_call.py: using BVCI 32924 09:08:48.969189 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:48.981280 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:48.994150 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:49.006145 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:49.019361 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:49.031327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:08:49.170574 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:08:49.290484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:49.772203 run create_hlr_db(pid=30093): Launched 09:08:49.928163 bus /sierra_2: Setting Powered False 09:08:50.987619 run create_hlr_db(pid=30093): Terminated: ok {rc=0} 09:08:51.429470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Launched 09:08:51.764906 run osmo-hlr_10.42.42.2(pid=30098): Launched 09:08:52.006694 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:52.673708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Launched 09:08:53.003908 run osmo-stp_10.42.42.5(pid=30101): Launched 09:08:53.248113 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:53.925387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30103): Launched 09:08:54.254090 run osmo-msc_10.42.42.6(pid=30104): Launched 09:08:54.614351 run osmo-stp_10.42.42.5(pid=30101): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] 09:08:54.879976 run osmo-stp_10.42.42.5(pid=30101): stdout: | (launched: 2022-12-13_09:08:52.941778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:55.067836 run osmo-stp_10.42.42.5(pid=30101): stderr: | 20221213090853234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090853234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090853234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090853235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090853235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090853235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090853235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:55.203519 run osmo-stp_10.42.42.5(pid=30101): stdout: | (launched: 2022-12-13_09:08:52.941778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:55.333494 run osmo-stp_10.42.42.5(pid=30101): stderr: | 20221213090853234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090853234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090853234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090853235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090853235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090853235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090853235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:55.487893 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30101): Process ended prematurely: osmo-stp_10.42.42.5(pid=30101) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:08:55.498528 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 09:08:55.527486 run osmo-hlr_10.42.42.2(pid=30098): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30098)] 09:08:55.579067 run osmo-hlr_10.42.42.2(pid=30098): stdout: | (launched: 2022-12-13_09:08:51.701287) 09:08:55.632651 run osmo-hlr_10.42.42.2(pid=30098): stderr: | 20221213090852015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090852015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090852015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090852015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090852015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090852015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090852030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090852039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090852039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090852039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:55.706847 run osmo-msc_10.42.42.6(pid=30104): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30104)] 09:08:55.758401 run osmo-msc_10.42.42.6(pid=30104): stdout: | (launched: 2022-12-13_09:08:54.190942) 09:08:55.811610 run osmo-msc_10.42.42.6(pid=30104): stderr: | 20221213090854691 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090854691 DLGLOBAL DEBUG validating counter group 0x7fbf6aa73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090854691 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090854691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090854691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090854691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090854701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090854702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090854702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090854702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:55.865175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Terminating (SIGTERM) 09:08:55.908744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Terminating (SIGTERM) 09:08:55.954176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30103): Terminating (SIGTERM) 09:08:55.999407 --- ParallelTerminationStrategy: PID 30097 died... 09:08:56.020284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Terminated: ok {rc=0} 09:08:56.069278 --- ParallelTerminationStrategy: PID 30100 died... 09:08:56.089879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Terminated: ok {rc=0} 09:08:56.137655 --- ParallelTerminationStrategy: PID 30103 died... 09:08:56.158435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30103): Terminated: ok {rc=0} 09:08:56.247544 bus /sierra_3: Setting Powered False 09:08:57.347366 bus /sierra_3: Setting Powered False 09:08:58.461571 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:08:59.610001 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:59.623614 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:08:59.698377 tst mo_mt_call_osmux.py: using LAC 32924 09:08:59.819028 tst mo_mt_call_osmux.py: using RAC 29 09:08:59.940403 tst mo_mt_call_osmux.py: using CellId 32924 09:09:00.064484 tst mo_mt_call_osmux.py: using BVCI 32925 09:09:00.176648 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:09:00.188848 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:09:00.201700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:09:00.215076 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:09:00.227033 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:09:00.238937 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:09:00.362490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:09:00.483881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:00.992818 run create_hlr_db(pid=30106): Launched 09:09:01.159141 bus /sierra_2: Setting Powered False 09:09:02.246019 run create_hlr_db(pid=30106): Terminated: ok {rc=0} 09:09:02.721917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30108): Launched 09:09:03.045689 run osmo-hlr_10.42.42.2(pid=30109): Launched 09:09:03.268508 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:04.005700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30111): Launched 09:09:04.330550 run osmo-stp_10.42.42.5(pid=30112): Launched 09:09:04.572915 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:05.301375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30114): Launched 09:09:05.626561 run osmo-msc_10.42.42.6(pid=30115): Launched 09:09:05.963269 run osmo-stp_10.42.42.5(pid=30112): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30112)] 09:09:06.237679 run osmo-stp_10.42.42.5(pid=30112): stdout: | (launched: 2022-12-13_09:09:04.269444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:06.509655 run osmo-stp_10.42.42.5(pid=30112): stderr: | 20221213090904606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090904606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090904606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090904607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090904607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090904607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090904607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:06.699162 run osmo-stp_10.42.42.5(pid=30112): stdout: | (launched: 2022-12-13_09:09:04.269444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:06.823514 run osmo-stp_10.42.42.5(pid=30112): stderr: | 20221213090904606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090904606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090904606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090904607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090904607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090904607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090904607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:06.970908 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30112): Process ended prematurely: osmo-stp_10.42.42.5(pid=30112) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30112)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:09:06.980887 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 09:09:07.008623 run osmo-hlr_10.42.42.2(pid=30109): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30109)] 09:09:07.061579 run osmo-hlr_10.42.42.2(pid=30109): stdout: | (launched: 2022-12-13_09:09:02.974448) 09:09:07.113994 run osmo-hlr_10.42.42.2(pid=30109): stderr: | 20221213090903321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090903321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090903321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090903322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090903322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090903322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090903341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090903354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090903354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090903354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:07.188461 run osmo-msc_10.42.42.6(pid=30115): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30115)] 09:09:07.239049 run osmo-msc_10.42.42.6(pid=30115): stdout: | (launched: 2022-12-13_09:09:05.564538) 09:09:07.291530 run osmo-msc_10.42.42.6(pid=30115): stderr: | 20221213090906166 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090906166 DLGLOBAL DEBUG validating counter group 0x7fd66d317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090906166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090906166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090906166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090906166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090906168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090906169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090906169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090906169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:07.344835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30108): Terminating (SIGTERM) 09:09:07.388461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30111): Terminating (SIGTERM) 09:09:07.434795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30114): Terminating (SIGTERM) 09:09:07.480381 --- ParallelTerminationStrategy: PID 30108 died... 09:09:07.503583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30108): Terminated: ok {rc=0} 09:09:07.552155 --- ParallelTerminationStrategy: PID 30111 died... 09:09:07.573536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30111): Terminated: ok {rc=0} 09:09:07.621471 --- ParallelTerminationStrategy: PID 30114 died... 09:09:07.642577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30114): Terminated: ok {rc=0} 09:09:07.733405 bus /sierra_3: Setting Powered False 09:09:08.833369 bus /sierra_3: Setting Powered False 09:09:09.947953 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:09:11.203044 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:11.209914 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:09:11.242775 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:09:11.270100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:09:11.325165 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:09:11.359704 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:09:11.387007 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:09:11.933218 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:09:11.982649 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:11.994403 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:09:12.061576 tst mo_mt_call.py: using LAC 32925 09:09:12.186196 tst mo_mt_call.py: using RAC 30 09:09:12.309863 tst mo_mt_call.py: using CellId 32925 09:09:12.433154 tst mo_mt_call.py: using BVCI 32926 09:09:12.548651 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:12.560260 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:12.571545 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:12.582780 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:12.594724 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:12.606652 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:09:12.725046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:09:12.842620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:13.336149 run create_hlr_db(pid=30122): Launched 09:09:13.465728 bus /sierra_2: Setting Powered False 09:09:14.529328 run create_hlr_db(pid=30122): Terminated: ok {rc=0} 09:09:14.970536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30124): Launched 09:09:15.287226 run osmo-hlr_10.42.42.2(pid=30125): Launched 09:09:15.408095 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:15.993821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30127): Launched 09:09:16.314071 run osmo-stp_10.42.42.5(pid=30128): Launched 09:09:16.619076 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:17.180432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30130): Launched 09:09:17.485621 run osmo-msc_10.42.42.6(pid=30131): Launched 09:09:17.654553 run osmo-stp_10.42.42.5(pid=30128): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30128)] 09:09:17.784045 run osmo-stp_10.42.42.5(pid=30128): stdout: | (launched: 2022-12-13_09:09:16.249288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:17.911294 run osmo-stp_10.42.42.5(pid=30128): stderr: | 20221213090916465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090916465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090916466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090916467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090916468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090916468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090916468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:18.036070 run osmo-stp_10.42.42.5(pid=30128): stdout: | (launched: 2022-12-13_09:09:16.249288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:18.155410 run osmo-stp_10.42.42.5(pid=30128): stderr: | 20221213090916465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090916465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090916466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090916467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090916468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090916468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090916468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:18.298133 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30128): Process ended prematurely: osmo-stp_10.42.42.5(pid=30128) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30128)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:09:18.307149 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:09:18.333561 run osmo-hlr_10.42.42.2(pid=30125): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30125)] 09:09:18.381830 run osmo-hlr_10.42.42.2(pid=30125): stdout: | (launched: 2022-12-13_09:09:15.230175) 09:09:18.431515 run osmo-hlr_10.42.42.2(pid=30125): stderr: | 20221213090915428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090915428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090915428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090915428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090915428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090915428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090915441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090915449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090915450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090915450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:18.500687 run osmo-msc_10.42.42.6(pid=30131): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30131)] 09:09:18.548200 run osmo-msc_10.42.42.6(pid=30131): stdout: | (launched: 2022-12-13_09:09:17.431026) 09:09:18.597896 run osmo-msc_10.42.42.6(pid=30131): stderr: | 20221213090917701 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090917701 DLGLOBAL DEBUG validating counter group 0x7f240e1d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090917702 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090917702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090917702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090917702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090917704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090917704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090917704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090917704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:18.647708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30124): Terminating (SIGTERM) 09:09:18.687631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30127): Terminating (SIGTERM) 09:09:18.727481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30130): Terminating (SIGTERM) 09:09:18.768141 --- ParallelTerminationStrategy: PID 30124 died... 09:09:18.787808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30124): Terminated: ok {rc=0} 09:09:18.832001 --- ParallelTerminationStrategy: PID 30127 died... 09:09:18.851233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30127): Terminated: ok {rc=0} 09:09:18.895228 --- ParallelTerminationStrategy: PID 30130 died... 09:09:18.914451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30130): Terminated: ok {rc=0} 09:09:19.000165 bus /sierra_3: Setting Powered False 09:09:20.100840 bus /sierra_3: Setting Powered False 09:09:21.216047 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:09:22.364062 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:22.376337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:09:22.447258 tst mo_mt_call_osmux.py: using LAC 32926 09:09:22.573544 tst mo_mt_call_osmux.py: using RAC 31 09:09:22.697816 tst mo_mt_call_osmux.py: using CellId 32926 09:09:22.816401 tst mo_mt_call_osmux.py: using BVCI 32927 09:09:22.927286 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:22.938628 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:22.949762 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:22.960691 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:22.971792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:22.983288 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:09:23.103398 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:09:23.225355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:23.684872 run create_hlr_db(pid=30133): Launched 09:09:23.798946 bus /sierra_2: Setting Powered False 09:09:24.858809 run create_hlr_db(pid=30133): Terminated: ok {rc=0} 09:09:25.272260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30135): Launched 09:09:25.567935 run osmo-hlr_10.42.42.2(pid=30136): Launched 09:09:25.680898 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:26.209464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30138): Launched 09:09:26.503392 run osmo-stp_10.42.42.5(pid=30139): Launched 09:09:26.616343 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:27.151202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30141): Launched 09:09:27.446398 run osmo-msc_10.42.42.6(pid=30142): Launched 09:09:27.613339 run osmo-stp_10.42.42.5(pid=30139): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30139)] 09:09:27.740420 run osmo-stp_10.42.42.5(pid=30139): stdout: | (launched: 2022-12-13_09:09:26.449948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:27.866066 run osmo-stp_10.42.42.5(pid=30139): stderr: | 20221213090926619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090926619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090926620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090926621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090926621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090926622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090926622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:27.989655 run osmo-stp_10.42.42.5(pid=30139): stdout: | (launched: 2022-12-13_09:09:26.449948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:28.107706 run osmo-stp_10.42.42.5(pid=30139): stderr: | 20221213090926619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090926619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090926620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090926621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090926621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090926622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090926622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:28.248938 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30139): Process ended prematurely: osmo-stp_10.42.42.5(pid=30139) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30139)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:09:28.257804 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 09:09:28.283769 run osmo-hlr_10.42.42.2(pid=30136): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30136)] 09:09:28.331342 run osmo-hlr_10.42.42.2(pid=30136): stdout: | (launched: 2022-12-13_09:09:25.513994) 09:09:28.380340 run osmo-hlr_10.42.42.2(pid=30136): stderr: | 20221213090925690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090925690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090925690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090925690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090925690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090925691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090925703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090925713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090925713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090925713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:28.449327 run osmo-msc_10.42.42.6(pid=30142): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30142)] 09:09:28.496195 run osmo-msc_10.42.42.6(pid=30142): stdout: | (launched: 2022-12-13_09:09:27.392494) 09:09:28.545229 run osmo-msc_10.42.42.6(pid=30142): stderr: | 20221213090927665 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090927665 DLGLOBAL DEBUG validating counter group 0x7ffac7b86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090927665 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090927665 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090927665 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090927666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090927667 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090927668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090927668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090927668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:28.594123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30135): Terminating (SIGTERM) 09:09:28.633709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30138): Terminating (SIGTERM) 09:09:28.673391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30141): Terminating (SIGTERM) 09:09:28.713711 --- ParallelTerminationStrategy: PID 30135 died... 09:09:28.732698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30135): Terminated: ok {rc=0} 09:09:28.776490 --- ParallelTerminationStrategy: PID 30138 died... 09:09:28.795152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30138): Terminated: ok {rc=0} 09:09:28.838509 --- ParallelTerminationStrategy: PID 30141 died... 09:09:28.857079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30141): Terminated: ok {rc=0} 09:09:28.939865 bus /sierra_3: Setting Powered False 09:09:30.036290 bus /sierra_3: Setting Powered False 09:09:31.148571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:09:32.415143 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:32.422276 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:09:32.455364 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:09:32.483216 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:09:32.535184 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:09:32.567657 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:09:32.593969 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:09:33.149880 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:09:33.200019 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:33.211077 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:09:33.277058 tst mo_mt_call.py: using LAC 32927 09:09:33.401025 tst mo_mt_call.py: using RAC 32 09:09:33.524353 tst mo_mt_call.py: using CellId 32927 09:09:33.651215 tst mo_mt_call.py: using BVCI 32928 09:09:33.768429 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:33.780140 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:33.791514 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:33.802829 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:33.814375 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:33.825818 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:33.941630 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:34.056051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:34.514738 run create_hlr_db(pid=30147): Launched 09:09:34.629167 bus /sierra_2: Setting Powered False 09:09:35.688141 run create_hlr_db(pid=30147): Terminated: ok {rc=0} 09:09:36.122128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30149): Launched 09:09:36.438885 run osmo-hlr_10.42.42.2(pid=30150): Launched 09:09:36.561017 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:37.108901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30152): Launched 09:09:37.427039 run osmo-stp_10.42.42.5(pid=30153): Launched 09:09:37.548487 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:38.124579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30155): Launched 09:09:38.442551 run osmo-msc_10.42.42.6(pid=30156): Launched 09:09:38.620546 run osmo-stp_10.42.42.5(pid=30153): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30153)] 09:09:38.756426 run osmo-stp_10.42.42.5(pid=30153): stdout: | (launched: 2022-12-13_09:09:37.369175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:38.891234 run osmo-stp_10.42.42.5(pid=30153): stderr: | 20221213090937560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090937560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090937560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090937561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090937561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090937561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090937561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:39.025206 run osmo-stp_10.42.42.5(pid=30153): stdout: | (launched: 2022-12-13_09:09:37.369175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:39.152049 run osmo-stp_10.42.42.5(pid=30153): stderr: | 20221213090937560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090937560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090937560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090937561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090937561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090937561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090937561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:39.304220 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30153): Process ended prematurely: osmo-stp_10.42.42.5(pid=30153) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30153)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:09:39.314111 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:09:39.341581 run osmo-hlr_10.42.42.2(pid=30150): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30150)] 09:09:39.391319 run osmo-hlr_10.42.42.2(pid=30150): stdout: | (launched: 2022-12-13_09:09:36.382079) 09:09:39.442825 run osmo-hlr_10.42.42.2(pid=30150): stderr: | 20221213090936578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090936578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090936578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090936578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090936578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090936578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090936591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090936601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090936601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090936601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:39.514265 run osmo-msc_10.42.42.6(pid=30156): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30156)] 09:09:39.563940 run osmo-msc_10.42.42.6(pid=30156): stdout: | (launched: 2022-12-13_09:09:38.385318) 09:09:39.615239 run osmo-msc_10.42.42.6(pid=30156): stderr: | 20221213090938704 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090938704 DLGLOBAL DEBUG validating counter group 0x7fe77228fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090938704 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090938704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090938705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090938705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090938708 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090938709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090938709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090938709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:39.666872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30149): Terminating (SIGTERM) 09:09:39.709177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30152): Terminating (SIGTERM) 09:09:39.750692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30155): Terminating (SIGTERM) 09:09:39.792487 --- ParallelTerminationStrategy: PID 30149 died... 09:09:39.812573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30149): Terminated: ok {rc=0} 09:09:39.858818 --- ParallelTerminationStrategy: PID 30152 died... 09:09:39.878418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30152): Terminated: ok {rc=0} 09:09:39.924256 --- ParallelTerminationStrategy: PID 30155 died... 09:09:39.943779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30155): Terminated: ok {rc=0} 09:09:40.030021 bus /sierra_3: Setting Powered False 09:09:41.127723 bus /sierra_3: Setting Powered False 09:09:42.243904 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:09:43.388704 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:43.400757 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:09:43.470597 tst mo_mt_call_osmux.py: using LAC 32928 09:09:43.588320 tst mo_mt_call_osmux.py: using RAC 33 09:09:43.706272 tst mo_mt_call_osmux.py: using CellId 32928 09:09:43.822787 tst mo_mt_call_osmux.py: using BVCI 32929 09:09:43.931674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:43.942744 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:43.953929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:43.964561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:43.976330 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:43.987569 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:44.101991 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:44.221501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:44.681688 run create_hlr_db(pid=30158): Launched 09:09:44.795304 bus /sierra_2: Setting Powered False 09:09:45.856770 run create_hlr_db(pid=30158): Terminated: ok {rc=0} 09:09:46.394404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30160): Launched 09:09:46.722294 run osmo-hlr_10.42.42.2(pid=30161): Launched 09:09:47.006752 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:47.695874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30163): Launched 09:09:47.992061 run osmo-stp_10.42.42.5(pid=30164): Launched 09:09:48.105387 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:48.639895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30166): Launched 09:09:48.934554 run osmo-msc_10.42.42.6(pid=30167): Launched 09:09:49.100007 run osmo-stp_10.42.42.5(pid=30164): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30164)] 09:09:49.226031 run osmo-stp_10.42.42.5(pid=30164): stdout: | (launched: 2022-12-13_09:09:47.938412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:49.351828 run osmo-stp_10.42.42.5(pid=30164): stderr: | 20221213090948110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090948110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090948110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090948110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090948111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090948111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090948111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:49.474889 run osmo-stp_10.42.42.5(pid=30164): stdout: | (launched: 2022-12-13_09:09:47.938412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:49.593579 run osmo-stp_10.42.42.5(pid=30164): stderr: | 20221213090948110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090948110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090948110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090948110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090948111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090948111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090948111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:49.734886 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30164): Process ended prematurely: osmo-stp_10.42.42.5(pid=30164) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30164)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:09:49.743917 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:09:49.769857 run osmo-hlr_10.42.42.2(pid=30161): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30161)] 09:09:49.817310 run osmo-hlr_10.42.42.2(pid=30161): stdout: | (launched: 2022-12-13_09:09:46.661575) 09:09:49.865921 run osmo-hlr_10.42.42.2(pid=30161): stderr: | 20221213090946943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090946943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090946943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090946943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090946943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090946943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090946956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090946986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090946986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090946986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:49.933810 run osmo-msc_10.42.42.6(pid=30167): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30167)] 09:09:49.980696 run osmo-msc_10.42.42.6(pid=30167): stdout: | (launched: 2022-12-13_09:09:48.881197) 09:09:50.029218 run osmo-msc_10.42.42.6(pid=30167): stderr: | 20221213090949154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090949154 DLGLOBAL DEBUG validating counter group 0x7f24440c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090949154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090949154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090949154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090949154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090949156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090949156 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090949157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090949157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:50.078125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30160): Terminating (SIGTERM) 09:09:50.117196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30163): Terminating (SIGTERM) 09:09:50.156047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30166): Terminating (SIGTERM) 09:09:50.195791 --- ParallelTerminationStrategy: PID 30160 died... 09:09:50.214535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30160): Terminated: ok {rc=0} 09:09:50.258330 --- ParallelTerminationStrategy: PID 30163 died... 09:09:50.276350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30163): Terminated: ok {rc=0} 09:09:50.319973 --- ParallelTerminationStrategy: PID 30166 died... 09:09:50.338226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30166): Terminated: ok {rc=0} 09:09:50.424064 bus /sierra_3: Setting Powered False 09:09:51.521184 bus /sierra_3: Setting Powered False 09:09:52.631958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:09:53.874931 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:53.881288 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:09:53.912891 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:09:53.939752 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:09:53.992794 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:09:54.025376 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:09:54.051780 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:09:54.600219 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:09:54.647997 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:54.659247 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:09:54.726779 tst mo_mt_call.py: using LAC 32929 09:09:54.842566 tst mo_mt_call.py: using RAC 34 09:09:54.960390 tst mo_mt_call.py: using CellId 32929 09:09:55.078222 tst mo_mt_call.py: using BVCI 32930 09:09:55.188506 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:55.199651 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:55.210610 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:55.221484 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:55.232717 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:55.243698 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:09:55.362806 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:09:55.481809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:55.974121 run create_hlr_db(pid=30172): Launched 09:09:56.103332 bus /sierra_2: Setting Powered False 09:09:57.166985 run create_hlr_db(pid=30172): Terminated: ok {rc=0} 09:09:57.590076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30174): Launched 09:09:57.885671 run osmo-hlr_10.42.42.2(pid=30175): Launched 09:09:57.998818 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:58.509384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30177): Launched 09:09:58.806022 run osmo-stp_10.42.42.5(pid=30178): Launched 09:09:58.919603 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:59.456651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30180): Launched 09:09:59.752584 run osmo-msc_10.42.42.6(pid=30181): Launched 09:09:59.919480 run osmo-stp_10.42.42.5(pid=30178): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30178)] 09:10:00.045962 run osmo-stp_10.42.42.5(pid=30178): stdout: | (launched: 2022-12-13_09:09:58.752346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:00.172043 run osmo-stp_10.42.42.5(pid=30178): stderr: | 20221213090958919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090958920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090958920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090958920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090958922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090958923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090958923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:00.296679 run osmo-stp_10.42.42.5(pid=30178): stdout: | (launched: 2022-12-13_09:09:58.752346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:00.415253 run osmo-stp_10.42.42.5(pid=30178): stderr: | 20221213090958919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213090958920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213090958920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213090958920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213090958922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213090958923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213090958923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:00.557651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30178): Process ended prematurely: osmo-stp_10.42.42.5(pid=30178) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30178)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:10:00.566546 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:10:00.592812 run osmo-hlr_10.42.42.2(pid=30175): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30175)] 09:10:00.641427 run osmo-hlr_10.42.42.2(pid=30175): stdout: | (launched: 2022-12-13_09:09:57.831946) 09:10:00.691119 run osmo-hlr_10.42.42.2(pid=30175): stderr: | 20221213090958004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213090958004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213090958004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213090958005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213090958005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213090958005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213090958016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213090958026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213090958027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213090958027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:00.760303 run osmo-msc_10.42.42.6(pid=30181): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30181)] 09:10:00.807770 run osmo-msc_10.42.42.6(pid=30181): stdout: | (launched: 2022-12-13_09:09:59.699014) 09:10:00.864550 run osmo-msc_10.42.42.6(pid=30181): stderr: | 20221213090959969 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213090959969 DLGLOBAL DEBUG validating counter group 0x7f69e3ba9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213090959969 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213090959969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213090959969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213090959970 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213090959971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213090959972 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213090959972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213090959972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:00.926386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30174): Terminating (SIGTERM) 09:10:00.967821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30177): Terminating (SIGTERM) 09:10:01.011311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30180): Terminating (SIGTERM) 09:10:01.055115 --- ParallelTerminationStrategy: PID 30174 died... 09:10:01.076126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30174): Terminated: ok {rc=0} 09:10:01.127597 --- ParallelTerminationStrategy: PID 30177 died... 09:10:01.147941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30177): Terminated: ok {rc=0} 09:10:01.204104 --- ParallelTerminationStrategy: PID 30180 died... 09:10:01.228106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30180): Terminated: ok {rc=0} 09:10:01.316274 bus /sierra_3: Setting Powered False 09:10:02.410428 bus /sierra_3: Setting Powered False 09:10:03.522551 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:10:04.663592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:10:04.675251 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:10:04.743188 tst mo_mt_call_osmux.py: using LAC 32930 09:10:04.858718 tst mo_mt_call_osmux.py: using RAC 35 09:10:04.977349 tst mo_mt_call_osmux.py: using CellId 32930 09:10:05.094912 tst mo_mt_call_osmux.py: using BVCI 32931 09:10:05.204212 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:10:05.215223 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:10:05.226227 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:10:05.236885 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:10:05.248072 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:10:05.259112 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:10:05.372433 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:10:05.487335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:05.948647 run create_hlr_db(pid=30186): Launched 09:10:06.062022 bus /sierra_2: Setting Powered False 09:10:07.121092 run create_hlr_db(pid=30186): Terminated: ok {rc=0} 09:10:07.555291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Launched 09:10:07.872748 run osmo-hlr_10.42.42.2(pid=30189): Launched 09:10:07.994895 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:08.545885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Launched 09:10:08.862087 run osmo-stp_10.42.42.5(pid=30192): Launched 09:10:08.984459 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:09.557044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Launched 09:10:09.872729 run osmo-msc_10.42.42.6(pid=30195): Launched 09:10:10.050548 run osmo-stp_10.42.42.5(pid=30192): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] 09:10:10.184594 run osmo-stp_10.42.42.5(pid=30192): stdout: | (launched: 2022-12-13_09:10:08.804775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:10.320152 run osmo-stp_10.42.42.5(pid=30192): stderr: | 20221213091008996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091008996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091008997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091008997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091008998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091008998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091008998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:10.454019 run osmo-stp_10.42.42.5(pid=30192): stdout: | (launched: 2022-12-13_09:10:08.804775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:10.580638 run osmo-stp_10.42.42.5(pid=30192): stderr: | 20221213091008996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091008996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091008997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091008997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091008998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091008998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091008998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:10.731700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30192): Process ended prematurely: osmo-stp_10.42.42.5(pid=30192) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:10:10.741222 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:10:10.768698 run osmo-hlr_10.42.42.2(pid=30189): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30189)] 09:10:10.818226 run osmo-hlr_10.42.42.2(pid=30189): stdout: | (launched: 2022-12-13_09:10:07.815685) 09:10:10.869283 run osmo-hlr_10.42.42.2(pid=30189): stderr: | 20221213091008013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091008013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091008013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091008013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091008013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091008013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091008026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091008034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091008034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091008034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:10.940536 run osmo-msc_10.42.42.6(pid=30195): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30195)] 09:10:10.989644 run osmo-msc_10.42.42.6(pid=30195): stdout: | (launched: 2022-12-13_09:10:09.815385) 09:10:11.040542 run osmo-msc_10.42.42.6(pid=30195): stderr: | 20221213091010138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091010138 DLGLOBAL DEBUG validating counter group 0x7efc780abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091010138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091010138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091010138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091010139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091010140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091010141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091010141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091010141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:11.091701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Terminating (SIGTERM) 09:10:11.132690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Terminating (SIGTERM) 09:10:11.173984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Terminating (SIGTERM) 09:10:11.216194 --- ParallelTerminationStrategy: PID 30188 died... 09:10:11.236475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Terminated: ok {rc=0} 09:10:11.282287 --- ParallelTerminationStrategy: PID 30191 died... 09:10:11.301448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Terminated: ok {rc=0} 09:10:11.347183 --- ParallelTerminationStrategy: PID 30194 died... 09:10:11.366750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Terminated: ok {rc=0} 09:10:11.452363 bus /sierra_3: Setting Powered False 09:10:12.550063 bus /sierra_3: Setting Powered False 09:10:13.664363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:10:14.908607 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:14.915303 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:10:14.946926 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:10:14.974536 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:10:15.024857 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:10:15.056836 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:10:15.084085 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:10:15.634894 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:10:15.683759 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:15.694713 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:10:15.763839 tst mo_mt_call.py: using LAC 32931 09:10:15.895399 tst mo_mt_call.py: using RAC 36 09:10:16.038990 tst mo_mt_call.py: using CellId 32931 09:10:16.167341 tst mo_mt_call.py: using BVCI 32932 09:10:16.312562 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:16.325503 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:16.338212 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:16.350826 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:16.363888 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:16.377027 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:10:16.500676 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:10:16.634887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:17.142872 run create_hlr_db(pid=30200): Launched 09:10:17.306374 bus /sierra_2: Setting Powered False 09:10:18.369750 run create_hlr_db(pid=30200): Terminated: ok {rc=0} 09:10:18.810747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Launched 09:10:19.126758 run osmo-hlr_10.42.42.2(pid=30203): Launched 09:10:19.248216 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:19.798220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Launched 09:10:20.115532 run osmo-stp_10.42.42.5(pid=30206): Launched 09:10:20.237832 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:20.811416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Launched 09:10:21.128797 run osmo-msc_10.42.42.6(pid=30209): Launched 09:10:21.307443 run osmo-stp_10.42.42.5(pid=30206): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] 09:10:21.441843 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-13_09:10:20.058198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:21.576770 run osmo-stp_10.42.42.5(pid=30206): stderr: | 20221213091020249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091020249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091020249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091020250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091020252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091020252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091020252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:21.711176 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-13_09:10:20.058198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:21.838416 run osmo-stp_10.42.42.5(pid=30206): stderr: | 20221213091020249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091020249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091020249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091020250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091020252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091020252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091020252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:21.990499 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30206): Process ended prematurely: osmo-stp_10.42.42.5(pid=30206) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:10:22.000208 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:10:22.028097 run osmo-hlr_10.42.42.2(pid=30203): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30203)] 09:10:22.077920 run osmo-hlr_10.42.42.2(pid=30203): stdout: | (launched: 2022-12-13_09:10:19.069620) 09:10:22.129681 run osmo-hlr_10.42.42.2(pid=30203): stderr: | 20221213091019269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091019269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091019269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091019269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091019270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091019270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091019283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091019291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091019292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091019292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:22.201469 run osmo-msc_10.42.42.6(pid=30209): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30209)] 09:10:22.251505 run osmo-msc_10.42.42.6(pid=30209): stdout: | (launched: 2022-12-13_09:10:21.070934) 09:10:22.303176 run osmo-msc_10.42.42.6(pid=30209): stderr: | 20221213091021393 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091021393 DLGLOBAL DEBUG validating counter group 0x7f17e8ff2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091021393 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091021393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091021393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091021394 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091021395 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091021396 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091021396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091021396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:22.354867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminating (SIGTERM) 09:10:22.396202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminating (SIGTERM) 09:10:22.437661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminating (SIGTERM) 09:10:22.480121 --- ParallelTerminationStrategy: PID 30202 died... 09:10:22.500124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminated: ok {rc=0} 09:10:22.546200 --- ParallelTerminationStrategy: PID 30205 died... 09:10:22.565814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminated: ok {rc=0} 09:10:22.611830 --- ParallelTerminationStrategy: PID 30208 died... 09:10:22.631447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminated: ok {rc=0} 09:10:22.719161 bus /sierra_3: Setting Powered False 09:10:23.818671 bus /sierra_3: Setting Powered False 09:10:24.934804 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:10:26.083191 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:26.095267 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:10:26.166910 tst mo_mt_call_osmux.py: using LAC 32932 09:10:26.294269 tst mo_mt_call_osmux.py: using RAC 37 09:10:26.421570 tst mo_mt_call_osmux.py: using CellId 32932 09:10:26.547422 tst mo_mt_call_osmux.py: using BVCI 32933 09:10:26.662779 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:26.674835 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:26.686187 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:26.697522 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:26.709493 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:26.721287 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:10:26.837994 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:10:26.957981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:27.451252 run create_hlr_db(pid=30211): Launched 09:10:27.581304 bus /sierra_2: Setting Powered False 09:10:28.644359 run create_hlr_db(pid=30211): Terminated: ok {rc=0} 09:10:29.085998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Launched 09:10:29.402974 run osmo-hlr_10.42.42.2(pid=30214): Launched 09:10:29.524594 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:30.069559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Launched 09:10:30.386493 run osmo-stp_10.42.42.5(pid=30217): Launched 09:10:30.507364 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:31.113519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Launched 09:10:31.434287 run osmo-msc_10.42.42.6(pid=30220): Launched 09:10:31.744698 run osmo-stp_10.42.42.5(pid=30217): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] 09:10:32.016185 run osmo-stp_10.42.42.5(pid=30217): stdout: | (launched: 2022-12-13_09:10:30.329167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:32.265152 run osmo-stp_10.42.42.5(pid=30217): stderr: | 20221213091030522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091030522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091030522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091030522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091030523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091030523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091030523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:32.407404 run osmo-stp_10.42.42.5(pid=30217): stdout: | (launched: 2022-12-13_09:10:30.329167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:32.528120 run osmo-stp_10.42.42.5(pid=30217): stderr: | 20221213091030522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091030522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091030522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091030522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091030523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091030523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091030523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:32.670295 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30217): Process ended prematurely: osmo-stp_10.42.42.5(pid=30217) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:10:32.679103 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:10:32.705249 run osmo-hlr_10.42.42.2(pid=30214): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30214)] 09:10:32.754712 run osmo-hlr_10.42.42.2(pid=30214): stdout: | (launched: 2022-12-13_09:10:29.345727) 09:10:32.804654 run osmo-hlr_10.42.42.2(pid=30214): stderr: | 20221213091029544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091029544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091029544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091029544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091029544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091029544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091029561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091029570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091029571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091029571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:32.875153 run osmo-msc_10.42.42.6(pid=30220): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30220)] 09:10:32.922166 run osmo-msc_10.42.42.6(pid=30220): stdout: | (launched: 2022-12-13_09:10:31.366650) 09:10:32.972036 run osmo-msc_10.42.42.6(pid=30220): stderr: | 20221213091031892 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091031892 DLGLOBAL DEBUG validating counter group 0x7fab9d750c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091031892 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091031892 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091031894 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091031896 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091031907 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091031909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091031911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091031911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:33.022027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Terminating (SIGTERM) 09:10:33.062134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Terminating (SIGTERM) 09:10:33.102380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Terminating (SIGTERM) 09:10:33.143209 --- ParallelTerminationStrategy: PID 30213 died... 09:10:33.162998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Terminated: ok {rc=0} 09:10:33.207595 --- ParallelTerminationStrategy: PID 30216 died... 09:10:33.227214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Terminated: ok {rc=0} 09:10:33.271572 --- ParallelTerminationStrategy: PID 30219 died... 09:10:33.290823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Terminated: ok {rc=0} 09:10:33.377814 bus /sierra_3: Setting Powered False 09:10:34.475290 bus /sierra_3: Setting Powered False 09:10:35.588872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:10:36.842777 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:36.849652 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:10:36.882485 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:10:36.909604 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:10:36.961083 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:10:36.994519 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:10:37.021545 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:10:37.571291 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:10:37.619424 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:37.630696 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:10:37.698643 tst mo_mt_call.py: using LAC 32933 09:10:37.815396 tst mo_mt_call.py: using RAC 38 09:10:37.933731 tst mo_mt_call.py: using CellId 32933 09:10:38.050233 tst mo_mt_call.py: using BVCI 32934 09:10:38.159981 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:38.171106 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:38.182072 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:38.192796 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:38.204078 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:38.215181 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:38.333955 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:38.449571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:38.908560 run create_hlr_db(pid=30225): Launched 09:10:39.021346 bus /sierra_2: Setting Powered False 09:10:40.080451 run create_hlr_db(pid=30225): Terminated: ok {rc=0} 09:10:40.495136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Launched 09:10:40.791953 run osmo-hlr_10.42.42.2(pid=30228): Launched 09:10:40.905781 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:41.415036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Launched 09:10:41.710131 run osmo-stp_10.42.42.5(pid=30231): Launched 09:10:41.823473 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:42.382252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Launched 09:10:42.678118 run osmo-msc_10.42.42.6(pid=30234): Launched 09:10:42.845259 run osmo-stp_10.42.42.5(pid=30231): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] 09:10:42.971755 run osmo-stp_10.42.42.5(pid=30231): stdout: | (launched: 2022-12-13_09:10:41.656547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:43.098185 run osmo-stp_10.42.42.5(pid=30231): stderr: | 20221213091041825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091041825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091041826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091041826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091041827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091041827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091041827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:43.222725 run osmo-stp_10.42.42.5(pid=30231): stdout: | (launched: 2022-12-13_09:10:41.656547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:43.341414 run osmo-stp_10.42.42.5(pid=30231): stderr: | 20221213091041825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091041825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091041826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091041826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091041827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091041827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091041827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:43.483025 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30231): Process ended prematurely: osmo-stp_10.42.42.5(pid=30231) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:10:43.491978 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:10:43.518313 run osmo-hlr_10.42.42.2(pid=30228): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30228)] 09:10:43.566134 run osmo-hlr_10.42.42.2(pid=30228): stdout: | (launched: 2022-12-13_09:10:40.737926) 09:10:43.615367 run osmo-hlr_10.42.42.2(pid=30228): stderr: | 20221213091040913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091040913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091040913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091040913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091040913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091040913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091040926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091040934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091040935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091040935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:43.684111 run osmo-msc_10.42.42.6(pid=30234): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30234)] 09:10:43.730785 run osmo-msc_10.42.42.6(pid=30234): stdout: | (launched: 2022-12-13_09:10:42.623875) 09:10:43.779859 run osmo-msc_10.42.42.6(pid=30234): stderr: | 20221213091042896 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091042897 DLGLOBAL DEBUG validating counter group 0x7f482e7b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091042897 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091042897 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091042897 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091042897 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091042899 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091042899 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091042900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091042900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:43.829212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Terminating (SIGTERM) 09:10:43.868773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Terminating (SIGTERM) 09:10:43.908409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Terminating (SIGTERM) 09:10:43.948260 --- ParallelTerminationStrategy: PID 30227 died... 09:10:43.967708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Terminated: ok {rc=0} 09:10:44.011881 --- ParallelTerminationStrategy: PID 30230 died... 09:10:44.030725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Terminated: ok {rc=0} 09:10:44.074730 --- ParallelTerminationStrategy: PID 30233 died... 09:10:44.093700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Terminated: ok {rc=0} 09:10:44.179506 bus /sierra_3: Setting Powered False 09:10:45.277944 bus /sierra_3: Setting Powered False 09:10:46.393265 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:10:47.538824 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:47.550663 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:10:47.619393 tst mo_mt_call_osmux.py: using LAC 32934 09:10:47.735666 tst mo_mt_call_osmux.py: using RAC 39 09:10:47.856898 tst mo_mt_call_osmux.py: using CellId 32934 09:10:47.973328 tst mo_mt_call_osmux.py: using BVCI 32935 09:10:48.080892 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:48.092164 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:48.103015 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:48.114036 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:48.125283 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:48.136371 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:48.251062 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:48.371204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:48.833058 run create_hlr_db(pid=30236): Launched 09:10:48.947150 bus /sierra_2: Setting Powered False 09:10:50.006829 run create_hlr_db(pid=30236): Terminated: ok {rc=0} 09:10:50.441154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Launched 09:10:50.757769 run osmo-hlr_10.42.42.2(pid=30239): Launched 09:10:50.878627 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:51.425394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Launched 09:10:51.741879 run osmo-stp_10.42.42.5(pid=30242): Launched 09:10:51.867403 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:52.441980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Launched 09:10:52.758138 run osmo-msc_10.42.42.6(pid=30245): Launched 09:10:52.935259 run osmo-stp_10.42.42.5(pid=30242): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] 09:10:53.070051 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-13_09:10:51.684686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:53.205079 run osmo-stp_10.42.42.5(pid=30242): stderr: | 20221213091051883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091051884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091051884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091051884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091051885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091051885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091051885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:53.339106 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-13_09:10:51.684686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:53.465940 run osmo-stp_10.42.42.5(pid=30242): stderr: | 20221213091051883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091051884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091051884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091051884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091051885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091051885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091051885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:53.617327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:10:53.626877 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:10:53.654312 run osmo-hlr_10.42.42.2(pid=30239): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30239)] 09:10:53.703803 run osmo-hlr_10.42.42.2(pid=30239): stdout: | (launched: 2022-12-13_09:10:50.700620) 09:10:53.755125 run osmo-hlr_10.42.42.2(pid=30239): stderr: | 20221213091050899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091050899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091050899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091050899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091050899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091050899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091050914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091050924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091050924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091050924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:53.826654 run osmo-msc_10.42.42.6(pid=30245): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30245)] 09:10:53.875909 run osmo-msc_10.42.42.6(pid=30245): stdout: | (launched: 2022-12-13_09:10:52.700679) 09:10:53.927097 run osmo-msc_10.42.42.6(pid=30245): stderr: | 20221213091053020 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091053020 DLGLOBAL DEBUG validating counter group 0x7f4ef0be4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091053020 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091053020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091053020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091053020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091053022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091053023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091053023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091053023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:53.978408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminating (SIGTERM) 09:10:54.019705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminating (SIGTERM) 09:10:54.061749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Terminating (SIGTERM) 09:10:54.103705 --- ParallelTerminationStrategy: PID 30238 died... 09:10:54.123843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminated: ok {rc=0} 09:10:54.169804 --- ParallelTerminationStrategy: PID 30241 died... 09:10:54.189294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminated: ok {rc=0} 09:10:54.234893 --- ParallelTerminationStrategy: PID 30244 died... 09:10:54.254927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Terminated: ok {rc=0} 09:10:54.342654 bus /sierra_3: Setting Powered False 09:10:55.441143 bus /sierra_3: Setting Powered False 09:10:56.555354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:10:57.806185 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:57.812216 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:10:57.845197 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:10:57.872299 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:10:57.924233 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:10:57.957769 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:10:57.985231 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:10:58.532727 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:10:58.580821 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:58.591787 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:10:58.660057 tst mo_mt_call.py: using LAC 32935 09:10:58.777090 tst mo_mt_call.py: using RAC 40 09:10:58.894755 tst mo_mt_call.py: using CellId 32935 09:10:59.013386 tst mo_mt_call.py: using BVCI 32936 09:10:59.123092 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:59.133991 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:59.144586 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:59.155295 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:59.166255 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:59.177245 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:10:59.296524 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:10:59.414824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:59.908119 run create_hlr_db(pid=30250): Launched 09:11:00.030482 bus /sierra_2: Setting Powered False 09:11:01.088788 run create_hlr_db(pid=30250): Terminated: ok {rc=0} 09:11:01.518480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Launched 09:11:01.871444 run osmo-hlr_10.42.42.2(pid=30253): Launched 09:11:02.056771 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:02.687281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Launched 09:11:02.983464 run osmo-stp_10.42.42.5(pid=30256): Launched 09:11:03.096721 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:03.634271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30258): Launched 09:11:03.930758 run osmo-msc_10.42.42.6(pid=30259): Launched 09:11:04.097254 run osmo-stp_10.42.42.5(pid=30256): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] 09:11:04.224065 run osmo-stp_10.42.42.5(pid=30256): stdout: | (launched: 2022-12-13_09:11:02.929425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:04.350828 run osmo-stp_10.42.42.5(pid=30256): stderr: | 20221213091103099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091103099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091103099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091103100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091103100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091103100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091103100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:04.475297 run osmo-stp_10.42.42.5(pid=30256): stdout: | (launched: 2022-12-13_09:11:02.929425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:04.594245 run osmo-stp_10.42.42.5(pid=30256): stderr: | 20221213091103099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091103099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091103099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091103100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091103100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091103100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091103100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:04.736052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30256): Process ended prematurely: osmo-stp_10.42.42.5(pid=30256) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:11:04.745122 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:11:04.771157 run osmo-hlr_10.42.42.2(pid=30253): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30253)] 09:11:04.819390 run osmo-hlr_10.42.42.2(pid=30253): stdout: | (launched: 2022-12-13_09:11:01.800824) 09:11:04.869112 run osmo-hlr_10.42.42.2(pid=30253): stderr: | 20221213091102100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091102100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091102100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091102100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091102100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091102100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091102123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091102140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091102141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091102141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:04.938532 run osmo-msc_10.42.42.6(pid=30259): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30259)] 09:11:04.986043 run osmo-msc_10.42.42.6(pid=30259): stdout: | (launched: 2022-12-13_09:11:03.876579) 09:11:05.035652 run osmo-msc_10.42.42.6(pid=30259): stderr: | 20221213091104150 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091104150 DLGLOBAL DEBUG validating counter group 0x7f65bd8e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091104150 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091104150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091104150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091104150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091104152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091104152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091104153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091104153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:05.085494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Terminating (SIGTERM) 09:11:05.125151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Terminating (SIGTERM) 09:11:05.165044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30258): Terminating (SIGTERM) 09:11:05.205465 --- ParallelTerminationStrategy: PID 30252 died... 09:11:05.224987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Terminated: ok {rc=0} 09:11:05.269368 --- ParallelTerminationStrategy: PID 30255 died... 09:11:05.288158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Terminated: ok {rc=0} 09:11:05.332800 --- ParallelTerminationStrategy: PID 30258 died... 09:11:05.352645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30258): Terminated: ok {rc=0} 09:11:05.439103 bus /sierra_3: Setting Powered False 09:11:06.537732 bus /sierra_3: Setting Powered False 09:11:07.653939 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:11:08.799018 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:11:08.810541 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:11:08.880271 tst mo_mt_call_osmux.py: using LAC 32936 09:11:09.000738 tst mo_mt_call_osmux.py: using RAC 41 09:11:09.117514 tst mo_mt_call_osmux.py: using CellId 32936 09:11:09.247311 tst mo_mt_call_osmux.py: using BVCI 32937 09:11:09.365710 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:11:09.377449 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:11:09.388711 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:11:09.400102 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:11:09.411809 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:11:09.423506 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:11:09.537400 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:11:09.652260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:10.113961 run create_hlr_db(pid=30261): Launched 09:11:10.227887 bus /sierra_2: Setting Powered False 09:11:11.288389 run create_hlr_db(pid=30261): Terminated: ok {rc=0} 09:11:11.722740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Launched 09:11:12.040093 run osmo-hlr_10.42.42.2(pid=30264): Launched 09:11:12.161253 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:12.710431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Launched 09:11:13.028174 run osmo-stp_10.42.42.5(pid=30267): Launched 09:11:13.149395 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:13.729460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Launched 09:11:14.046676 run osmo-msc_10.42.42.6(pid=30270): Launched 09:11:14.223764 run osmo-stp_10.42.42.5(pid=30267): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] 09:11:14.358178 run osmo-stp_10.42.42.5(pid=30267): stdout: | (launched: 2022-12-13_09:11:12.969981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:14.492791 run osmo-stp_10.42.42.5(pid=30267): stderr: | 20221213091113162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091113162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091113163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091113163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091113163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091113164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091113164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:14.626423 run osmo-stp_10.42.42.5(pid=30267): stdout: | (launched: 2022-12-13_09:11:12.969981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:14.753395 run osmo-stp_10.42.42.5(pid=30267): stderr: | 20221213091113162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091113162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091113163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091113163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091113163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091113164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091113164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:14.905228 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30267): Process ended prematurely: osmo-stp_10.42.42.5(pid=30267) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:11:14.914800 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:11:14.942297 run osmo-hlr_10.42.42.2(pid=30264): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30264)] 09:11:14.992419 run osmo-hlr_10.42.42.2(pid=30264): stdout: | (launched: 2022-12-13_09:11:11.982540) 09:11:15.044201 run osmo-hlr_10.42.42.2(pid=30264): stderr: | 20221213091112180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091112180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091112180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091112180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091112180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091112180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091112232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091112242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091112242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091112243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:15.116219 run osmo-msc_10.42.42.6(pid=30270): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30270)] 09:11:15.165792 run osmo-msc_10.42.42.6(pid=30270): stdout: | (launched: 2022-12-13_09:11:13.989331) 09:11:15.217273 run osmo-msc_10.42.42.6(pid=30270): stderr: | 20221213091114313 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091114313 DLGLOBAL DEBUG validating counter group 0x7f9f4e97ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091114313 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091114313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091114313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091114313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091114315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091114315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091114316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091114316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:15.269498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Terminating (SIGTERM) 09:11:15.311209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Terminating (SIGTERM) 09:11:15.352938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Terminating (SIGTERM) 09:11:15.394800 --- ParallelTerminationStrategy: PID 30263 died... 09:11:15.414821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Terminated: ok {rc=0} 09:11:15.460864 --- ParallelTerminationStrategy: PID 30266 died... 09:11:15.480822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Terminated: ok {rc=0} 09:11:15.528099 --- ParallelTerminationStrategy: PID 30269 died... 09:11:15.547675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Terminated: ok {rc=0} 09:11:15.634855 bus /sierra_3: Setting Powered False 09:11:16.732516 bus /sierra_3: Setting Powered False 09:11:17.849640 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:11:19.093986 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:11:19.100183 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:11:19.135902 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 09:11:19.163202 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 09:11:19.217918 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:11:19.249924 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 09:11:19.276681 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 09:11:19.826142 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 09:11:19.874733 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:19.886099 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:11:19.936885 tst mo_mt_call.py: using LAC 32937 09:11:20.056869 tst mo_mt_call.py: using RAC 42 09:11:20.173298 tst mo_mt_call.py: using CellId 32937 09:11:20.290601 tst mo_mt_call.py: using BVCI 32938 09:11:20.400314 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:20.411828 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:20.422915 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:20.434068 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:20.446131 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:20.458088 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:11:20.577909 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:11:20.693315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:21.154142 run create_hlr_db(pid=30275): Launched 09:11:21.267229 bus /sierra_2: Setting Powered False 09:11:22.326539 run create_hlr_db(pid=30275): Terminated: ok {rc=0} 09:11:22.760165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30277): Launched 09:11:23.077652 run osmo-hlr_10.42.42.2(pid=30278): Launched 09:11:23.199097 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:23.747600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30280): Launched 09:11:24.065662 run osmo-stp_10.42.42.5(pid=30281): Launched 09:11:24.187038 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:24.764176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30283): Launched 09:11:25.082270 run osmo-msc_10.42.42.6(pid=30284): Launched 09:11:25.259844 run osmo-stp_10.42.42.5(pid=30281): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30281)] 09:11:25.394840 run osmo-stp_10.42.42.5(pid=30281): stdout: | (launched: 2022-12-13_09:11:24.008161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:25.529142 run osmo-stp_10.42.42.5(pid=30281): stderr: | 20221213091124198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091124198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091124198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091124199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091124199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091124199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091124199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:25.663767 run osmo-stp_10.42.42.5(pid=30281): stdout: | (launched: 2022-12-13_09:11:24.008161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:25.791040 run osmo-stp_10.42.42.5(pid=30281): stderr: | 20221213091124198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091124198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091124198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091124199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091124199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091124199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091124199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:25.943141 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30281): Process ended prematurely: osmo-stp_10.42.42.5(pid=30281) [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30281)] [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 09:11:25.952487 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:11:25.980040 run osmo-hlr_10.42.42.2(pid=30278): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30278)] 09:11:26.029901 run osmo-hlr_10.42.42.2(pid=30278): stdout: | (launched: 2022-12-13_09:11:23.020335) 09:11:26.081597 run osmo-hlr_10.42.42.2(pid=30278): stderr: | 20221213091123218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091123219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091123219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091123219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091123219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091123219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091123231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091123239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091123240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091123240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:26.153796 run osmo-msc_10.42.42.6(pid=30284): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30284)] 09:11:26.203417 run osmo-msc_10.42.42.6(pid=30284): stdout: | (launched: 2022-12-13_09:11:25.024405) 09:11:26.254781 run osmo-msc_10.42.42.6(pid=30284): stderr: | 20221213091125348 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091125349 DLGLOBAL DEBUG validating counter group 0x7fac25ba2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091125349 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091125349 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091125349 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091125349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091125351 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091125351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091125351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091125352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:26.306754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30277): Terminating (SIGTERM) 09:11:26.348603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30280): Terminating (SIGTERM) 09:11:26.390526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30283): Terminating (SIGTERM) 09:11:26.432305 --- ParallelTerminationStrategy: PID 30277 died... 09:11:26.452311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30277): Terminated: ok {rc=0} 09:11:26.498289 --- ParallelTerminationStrategy: PID 30280 died... 09:11:26.517931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30280): Terminated: ok {rc=0} 09:11:26.564096 --- ParallelTerminationStrategy: PID 30283 died... 09:11:26.583562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30283): Terminated: ok {rc=0} 09:11:26.670765 bus /sierra_3: Setting Powered False 09:11:27.767706 bus /sierra_3: Setting Powered False 09:11:28.885223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 09:11:30.028666 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:30.040613 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:11:30.092487 tst mo_mt_call_osmux.py: using LAC 32938 09:11:30.210306 tst mo_mt_call_osmux.py: using RAC 43 09:11:30.329703 tst mo_mt_call_osmux.py: using CellId 32938 09:11:30.455419 tst mo_mt_call_osmux.py: using BVCI 32939 09:11:30.572757 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:30.584693 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:30.596249 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:30.608016 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:30.619671 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:11:30.631194 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:11:30.746058 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:11:30.867361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:31.357389 run create_hlr_db(pid=30286): Launched 09:11:31.513152 bus /sierra_2: Setting Powered False 09:11:32.573830 run create_hlr_db(pid=30286): Terminated: ok {rc=0} 09:11:32.989373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30288): Launched 09:11:33.287270 run osmo-hlr_10.42.42.2(pid=30289): Launched 09:11:33.402122 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:33.926700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30291): Launched 09:11:34.224743 run osmo-stp_10.42.42.5(pid=30292): Launched 09:11:34.339523 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:34.880487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30294): Launched 09:11:35.178862 run osmo-msc_10.42.42.6(pid=30295): Launched 09:11:35.346581 run osmo-stp_10.42.42.5(pid=30292): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30292)] 09:11:35.473736 run osmo-stp_10.42.42.5(pid=30292): stdout: | (launched: 2022-12-13_09:11:34.170662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:35.600393 run osmo-stp_10.42.42.5(pid=30292): stderr: | 20221213091134340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091134341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091134341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091134341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091134342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091134342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091134342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:35.724736 run osmo-stp_10.42.42.5(pid=30292): stdout: | (launched: 2022-12-13_09:11:34.170662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:35.843806 run osmo-stp_10.42.42.5(pid=30292): stderr: | 20221213091134340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091134341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091134341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091134341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091134342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091134342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091134342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:35.986466 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30292): Process ended prematurely: osmo-stp_10.42.42.5(pid=30292) [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30292)] [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 09:11:35.995323 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:11:36.021625 run osmo-hlr_10.42.42.2(pid=30289): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30289)] 09:11:36.069772 run osmo-hlr_10.42.42.2(pid=30289): stdout: | (launched: 2022-12-13_09:11:33.233345) 09:11:36.119443 run osmo-hlr_10.42.42.2(pid=30289): stderr: | 20221213091133406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091133406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091133406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091133406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091133406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091133406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091133418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091133427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091133428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091133428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:36.188508 run osmo-msc_10.42.42.6(pid=30295): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30295)] 09:11:36.235893 run osmo-msc_10.42.42.6(pid=30295): stdout: | (launched: 2022-12-13_09:11:35.125020) 09:11:36.285258 run osmo-msc_10.42.42.6(pid=30295): stderr: | 20221213091135393 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091135393 DLGLOBAL DEBUG validating counter group 0x7f28ac990c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091135393 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091135393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091135394 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091135394 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091135395 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091135396 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091135396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091135396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:36.335055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30288): Terminating (SIGTERM) 09:11:36.375066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30291): Terminating (SIGTERM) 09:11:36.414920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30294): Terminating (SIGTERM) 09:11:36.455078 --- ParallelTerminationStrategy: PID 30288 died... 09:11:36.474258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30288): Terminated: ok {rc=0} 09:11:36.518087 --- ParallelTerminationStrategy: PID 30291 died... 09:11:36.536921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30291): Terminated: ok {rc=0} 09:11:36.580802 --- ParallelTerminationStrategy: PID 30294 died... 09:11:36.600475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30294): Terminated: ok {rc=0} 09:11:36.683966 bus /sierra_3: Setting Powered False 09:11:37.781180 bus /sierra_3: Setting Powered False 09:11:38.899851 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:trx-umtrx --------------------------------------------------------------------- 09:11:40.154982 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:11:40.159816 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:11:40.192721 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:11:40.220520 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 09:11:40.306762 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:11:40.340010 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:11:40.367523 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 09:11:40.951584 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 09:11:40.957218 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:40.968375 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 09:11:41.018140 tst emergency_mo_mt_call.py: using LAC 32939 09:11:41.142224 tst emergency_mo_mt_call.py: using RAC 44 09:11:41.264858 tst emergency_mo_mt_call.py: using CellId 32939 09:11:41.389834 tst emergency_mo_mt_call.py: using BVCI 32940 09:11:41.504574 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:41.515880 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:41.527145 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:41.538192 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:41.549367 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:41.560690 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:11:41.676930 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:11:41.795948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:42.251164 run create_hlr_db(pid=30300): Launched 09:11:42.363691 bus /sierra_2: Setting Powered False 09:11:43.421903 run create_hlr_db(pid=30300): Terminated: ok {rc=0} 09:11:43.848866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30302): Launched 09:11:44.161673 run osmo-hlr_10.42.42.2(pid=30303): Launched 09:11:44.281276 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:44.824729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30305): Launched 09:11:45.138221 run osmo-stp_10.42.42.5(pid=30306): Launched 09:11:45.266935 tst emergency_mo_mt_call.py: using MSISDN 8078 09:11:45.428216 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:46.043213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30308): Launched 09:11:46.407871 run osmo-msc_10.42.42.6(pid=30309): Launched 09:11:46.981972 run osmo-stp_10.42.42.5(pid=30306): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30306)] 09:11:47.201461 run osmo-stp_10.42.42.5(pid=30306): stdout: | (launched: 2022-12-13_09:11:45.081390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:47.334765 run osmo-stp_10.42.42.5(pid=30306): stderr: | 20221213091145272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091145272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091145272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091145273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091145275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091145275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091145275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:47.466135 run osmo-stp_10.42.42.5(pid=30306): stdout: | (launched: 2022-12-13_09:11:45.081390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:47.591871 run osmo-stp_10.42.42.5(pid=30306): stderr: | 20221213091145272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091145272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091145272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091145273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091145275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091145275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091145275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:47.742266 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30306): Process ended prematurely: osmo-stp_10.42.42.5(pid=30306) [trial-2387↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30306)] [trial-2387↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 09:11:47.751286 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 09:11:47.778673 run osmo-hlr_10.42.42.2(pid=30303): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30303)] 09:11:47.828941 run osmo-hlr_10.42.42.2(pid=30303): stdout: | (launched: 2022-12-13_09:11:44.105014) 09:11:47.880849 run osmo-hlr_10.42.42.2(pid=30303): stderr: | 20221213091144301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091144301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091144301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091144301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091144301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091144301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091144314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091144322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091144322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091144322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:47.953164 run osmo-msc_10.42.42.6(pid=30309): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30309)] 09:11:48.003207 run osmo-msc_10.42.42.6(pid=30309): stdout: | (launched: 2022-12-13_09:11:46.335685) 09:11:48.055029 run osmo-msc_10.42.42.6(pid=30309): stderr: | 20221213091146898 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091146898 DLGLOBAL DEBUG validating counter group 0x7f2126c39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091146898 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091146898 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091146898 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091146899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091146900 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091146901 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091146901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091146901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:48.107060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30302): Terminating (SIGTERM) 09:11:48.148824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30305): Terminating (SIGTERM) 09:11:48.190913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30308): Terminating (SIGTERM) 09:11:48.233658 --- ParallelTerminationStrategy: PID 30302 died... 09:11:48.253989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30302): Terminated: ok {rc=0} 09:11:48.301044 --- ParallelTerminationStrategy: PID 30305 died... 09:11:48.321114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30305): Terminated: ok {rc=0} 09:11:48.367417 --- ParallelTerminationStrategy: PID 30308 died... 09:11:48.387159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30308): Terminated: ok {rc=0} 09:11:48.474875 bus /sierra_3: Setting Powered False 09:11:49.573268 bus /sierra_3: Setting Powered False 09:11:50.689097 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 09:11:51.776200 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:51.788782 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 09:11:51.840574 tst emergency_preemptive_call.py: using LAC 32940 09:11:51.964689 tst emergency_preemptive_call.py: using RAC 45 09:11:52.089503 tst emergency_preemptive_call.py: using CellId 32940 09:11:52.212861 tst emergency_preemptive_call.py: using BVCI 32941 09:11:52.329077 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:52.340295 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:52.351325 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:52.362450 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:52.373410 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:11:52.384289 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:11:52.500049 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:11:52.621235 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:11:52.736039 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:11:52.852157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:53.341134 run create_hlr_db(pid=30311): Launched 09:11:53.469493 bus /sierra_2: Setting Powered False 09:11:54.532635 run create_hlr_db(pid=30311): Terminated: ok {rc=0} 09:11:54.953382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Launched 09:11:55.246373 run osmo-hlr_10.42.42.2(pid=30314): Launched 09:11:55.358384 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:55.878736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Launched 09:11:56.171117 run osmo-stp_10.42.42.5(pid=30317): Launched 09:11:56.292602 tst emergency_preemptive_call.py: using MSISDN 8079 09:11:56.447602 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:56.974460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30319): Launched 09:11:57.266285 run osmo-msc_10.42.42.6(pid=30320): Launched 09:11:57.429755 run osmo-stp_10.42.42.5(pid=30317): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] 09:11:57.555820 run osmo-stp_10.42.42.5(pid=30317): stdout: | (launched: 2022-12-13_09:11:56.117785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:57.680906 run osmo-stp_10.42.42.5(pid=30317): stderr: | 20221213091156289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091156289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091156289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091156290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091156291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091156291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091156291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:57.803764 run osmo-stp_10.42.42.5(pid=30317): stdout: | (launched: 2022-12-13_09:11:56.117785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:57.921437 run osmo-stp_10.42.42.5(pid=30317): stderr: | 20221213091156289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091156289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091156289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091156290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091156291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091156291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091156291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:58.060924 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30317): Process ended prematurely: osmo-stp_10.42.42.5(pid=30317) [trial-2387↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] [trial-2387↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 09:11:58.069290 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 09:11:58.095284 run osmo-hlr_10.42.42.2(pid=30314): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30314)] 09:11:58.143170 run osmo-hlr_10.42.42.2(pid=30314): stdout: | (launched: 2022-12-13_09:11:55.192621) 09:11:58.192290 run osmo-hlr_10.42.42.2(pid=30314): stderr: | 20221213091155366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091155366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091155366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091155366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091155366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091155366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091155378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091155389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091155389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091155389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:58.261446 run osmo-msc_10.42.42.6(pid=30320): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30320)] 09:11:58.308655 run osmo-msc_10.42.42.6(pid=30320): stdout: | (launched: 2022-12-13_09:11:57.212878) 09:11:58.358095 run osmo-msc_10.42.42.6(pid=30320): stderr: | 20221213091157484 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091157484 DLGLOBAL DEBUG validating counter group 0x7fcc6534ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091157484 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091157484 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091157484 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091157484 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091157486 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091157487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091157487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091157487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:58.407606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Terminating (SIGTERM) 09:11:58.447531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Terminating (SIGTERM) 09:11:58.487804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30319): Terminating (SIGTERM) 09:11:58.528141 --- ParallelTerminationStrategy: PID 30313 died... 09:11:58.547672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30313): Terminated: ok {rc=0} 09:11:58.592033 --- ParallelTerminationStrategy: PID 30316 died... 09:11:58.611116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30316): Terminated: ok {rc=0} 09:11:58.655365 --- ParallelTerminationStrategy: PID 30319 died... 09:11:58.674310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30319): Terminated: ok {rc=0} 09:11:58.757322 bus /sierra_9: Setting Powered False 09:11:59.854354 bus /sierra_9: Setting Powered False 09:12:00.973750 bus /sierra_8: Setting Powered False 09:12:02.083079 bus /sierra_8: Setting Powered False 09:12:03.201650 bus /sierra_3: Setting Powered False 09:12:04.299533 bus /sierra_3: Setting Powered False 09:12:05.414941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx --------------------------------------------------------------------- 09:12:06.693715 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:12:06.698523 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:12:06.731975 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 09:12:06.771241 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 09:12:06.859740 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:12:06.892632 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 09:12:06.932407 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 09:12:07.524737 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 09:12:07.576661 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:07.587631 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:12:07.655004 tst cs_paging_gprs_active.py: using LAC 32941 09:12:07.779143 tst cs_paging_gprs_active.py: using RAC 46 09:12:07.895508 tst cs_paging_gprs_active.py: using CellId 32941 09:12:08.010683 tst cs_paging_gprs_active.py: using BVCI 32942 09:12:08.118947 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.129711 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.140178 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.150679 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.161370 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.172011 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.182897 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.193861 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:08.204563 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:08.324726 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:08.443408 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:12:08.645805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:08.945721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30326): Launched 09:12:09.205550 run iperf3-srv_10.42.42.10(pid=30327): Launched 09:12:09.317936 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:12:09.518643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:09.817902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30328): Launched 09:12:10.076746 run iperf3-srv_10.42.42.10(pid=30329): Launched 09:12:10.188767 tst cs_paging_gprs_active.py:38: start network... 09:12:10.388858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:10.851304 run create_hlr_db(pid=30330): Launched 09:12:10.965483 bus /sierra_2: Setting Powered False 09:12:12.025114 run create_hlr_db(pid=30330): Terminated: ok {rc=0} 09:12:12.463209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Launched 09:12:12.782931 run osmo-hlr_10.42.42.2(pid=30333): Launched 09:12:12.906294 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:13.455790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Launched 09:12:13.775593 run osmo-stp_10.42.42.5(pid=30336): Launched 09:12:13.898853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:14.450793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30338): Launched 09:12:14.573295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:14.842985 run patchelf(pid=30339): Launched 09:12:15.020388 run osmo-stp_10.42.42.5(pid=30336): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] 09:12:15.155753 run osmo-stp_10.42.42.5(pid=30336): stdout: | (launched: 2022-12-13_09:12:13.717834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:15.293632 run osmo-stp_10.42.42.5(pid=30336): stderr: | 20221213091213909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091213909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091213909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091213910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091213912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091213912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091213912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:15.431107 run osmo-stp_10.42.42.5(pid=30336): stdout: | (launched: 2022-12-13_09:12:13.717834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:15.562084 run osmo-stp_10.42.42.5(pid=30336): stderr: | 20221213091213909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091213909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091213909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091213910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091213912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091213912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091213912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:15.717496 run patchelf(pid=30339): Terminating (SIGINT) 09:12:15.916474 run patchelf(pid=30339): Terminated: ok {rc=0} 09:12:16.043072 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30336): Process ended prematurely: osmo-stp_10.42.42.5(pid=30336) [trial-2387↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] [trial-2387↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 09:12:16.053787 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:12:16.082331 run osmo-hlr_10.42.42.2(pid=30333): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30333)] 09:12:16.135277 run osmo-hlr_10.42.42.2(pid=30333): stdout: | (launched: 2022-12-13_09:12:12.725010) 09:12:16.188432 run osmo-hlr_10.42.42.2(pid=30333): stderr: | 20221213091212925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091212925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091212925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091212925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091212925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091212925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091212947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091212957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091212957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091212957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:16.242291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30326): Terminating (SIGTERM) 09:12:16.284180 run iperf3-srv_10.42.42.10(pid=30327): Terminating (SIGTERM) 09:12:16.326614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30328): Terminating (SIGTERM) 09:12:16.369458 run iperf3-srv_10.42.42.10(pid=30329): Terminating (SIGTERM) 09:12:16.413126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Terminating (SIGTERM) 09:12:16.457837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Terminating (SIGTERM) 09:12:16.502431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30338): Terminating (SIGTERM) 09:12:16.547953 --- ParallelTerminationStrategy: PID 30326 died... 09:12:16.569539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30326): Terminated: ok {rc=0} 09:12:16.618137 --- ParallelTerminationStrategy: PID 30327 died... 09:12:16.639979 run iperf3-srv_10.42.42.10(pid=30327): Terminated {rc=256} 09:12:16.686965 --- ParallelTerminationStrategy: PID 30328 died... 09:12:16.707974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30328): Terminated: ok {rc=0} 09:12:16.754537 --- ParallelTerminationStrategy: PID 30329 died... 09:12:16.775462 run iperf3-srv_10.42.42.10(pid=30329): Terminated {rc=256} 09:12:16.822316 --- ParallelTerminationStrategy: PID 30332 died... 09:12:16.843838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Terminated: ok {rc=0} 09:12:16.890990 --- ParallelTerminationStrategy: PID 30335 died... 09:12:16.912030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Terminated: ok {rc=0} 09:12:16.958762 --- ParallelTerminationStrategy: PID 30338 died... 09:12:16.979872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30338): Terminated: ok {rc=0} 09:12:17.070278 bus /gobi_0: Setting Powered False 09:12:18.166259 bus /gobi_0: Setting Powered False 09:12:19.282048 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx iperf3.py ---------------------------------------------- 09:12:20.427499 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:20.439089 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:12:20.490043 tst iperf3.py: using LAC 32942 09:12:20.617294 tst iperf3.py: using RAC 47 09:12:20.743713 tst iperf3.py: using CellId 32942 09:12:20.869704 tst iperf3.py: using BVCI 32943 09:12:20.986666 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:20.997974 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:21.009074 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:21.019987 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:21.030880 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:21.041671 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:21.052535 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:21.063367 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:21.074329 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:21.190137 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:12:21.391470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:21.690698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30340): Launched 09:12:21.950463 run iperf3-srv_10.42.42.10(pid=30341): Launched 09:12:22.063245 tst iperf3.py:8: start network... 09:12:22.263643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:22.724625 run create_hlr_db(pid=30342): Launched 09:12:22.839423 bus /gobi_6: Setting Powered False 09:12:23.898794 run create_hlr_db(pid=30342): Terminated: ok {rc=0} 09:12:24.334142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30344): Launched 09:12:24.652565 run osmo-hlr_10.42.42.2(pid=30345): Launched 09:12:24.776413 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:25.327129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30347): Launched 09:12:25.644781 run osmo-stp_10.42.42.5(pid=30348): Launched 09:12:25.767431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:26.317617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30350): Launched 09:12:26.438736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:26.707374 run patchelf(pid=30351): Launched 09:12:26.883922 run osmo-stp_10.42.42.5(pid=30348): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30348)] 09:12:27.019355 run osmo-stp_10.42.42.5(pid=30348): stdout: | (launched: 2022-12-13_09:12:25.587106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:27.156306 run osmo-stp_10.42.42.5(pid=30348): stderr: | 20221213091225777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091225777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091225778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091225778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091225778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091225779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091225779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:27.293725 run osmo-stp_10.42.42.5(pid=30348): stdout: | (launched: 2022-12-13_09:12:25.587106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:27.425152 run osmo-stp_10.42.42.5(pid=30348): stderr: | 20221213091225777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091225777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091225778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091225778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091225778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091225779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091225779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:27.580308 run patchelf(pid=30351): Terminating (SIGINT) 09:12:27.758960 run patchelf(pid=30351): Terminated: ok {rc=0} 09:12:27.888043 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30348): Process ended prematurely: osmo-stp_10.42.42.5(pid=30348) [trial-2387↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30348)] [trial-2387↪gprs:trx-umtrx↪iperf3.py:8] 09:12:27.898045 tst iperf3.py:8: Test FAILED (7.5 sec) 09:12:27.925916 run osmo-hlr_10.42.42.2(pid=30345): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30345)] 09:12:27.975726 run osmo-hlr_10.42.42.2(pid=30345): stdout: | (launched: 2022-12-13_09:12:24.595181) 09:12:28.027028 run osmo-hlr_10.42.42.2(pid=30345): stderr: | 20221213091224792 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091224792 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091224792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091224792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091224792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091224792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091224820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091224831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091224831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091224831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:28.078725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30340): Terminating (SIGTERM) 09:12:28.120274 run iperf3-srv_10.42.42.10(pid=30341): Terminating (SIGTERM) 09:12:28.162232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30344): Terminating (SIGTERM) 09:12:28.203749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30347): Terminating (SIGTERM) 09:12:28.245156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30350): Terminating (SIGTERM) 09:12:28.286885 --- ParallelTerminationStrategy: PID 30340 died... 09:12:28.307145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30340): Terminated: ok {rc=0} 09:12:28.353134 --- ParallelTerminationStrategy: PID 30341 died... 09:12:28.372290 run iperf3-srv_10.42.42.10(pid=30341): Terminated {rc=256} 09:12:28.418262 --- ParallelTerminationStrategy: PID 30344 died... 09:12:28.437670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30344): Terminated: ok {rc=0} 09:12:28.483425 --- ParallelTerminationStrategy: PID 30347 died... 09:12:28.502889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30347): Terminated: ok {rc=0} 09:12:28.548598 --- ParallelTerminationStrategy: PID 30350 died... 09:12:28.568058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30350): Terminated: ok {rc=0} 09:12:28.654111 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 09:12:29.802212 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:29.817341 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:12:29.865097 tst iperf3m4.py: using LAC 32943 09:12:29.990278 tst iperf3m4.py: using RAC 48 09:12:30.116917 tst iperf3m4.py: using CellId 32943 09:12:30.242841 tst iperf3m4.py: using BVCI 32944 09:12:30.359480 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.370756 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.381822 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.392681 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.403605 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.414550 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.425730 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.436653 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:30.447496 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:30.566499 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:30.690632 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:30.806427 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:30.951908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:12:31.182577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:31.515052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Launched 09:12:31.811760 run iperf3-srv_10.42.42.10(pid=30353): Launched 09:12:31.947488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:12:32.168560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:32.490913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30354): Launched 09:12:32.769332 run iperf3-srv_10.42.42.10(pid=30355): Launched 09:12:32.889416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:12:33.106871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:33.428330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30356): Launched 09:12:33.690921 run iperf3-srv_10.42.42.10(pid=30357): Launched 09:12:33.802983 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:12:34.003402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:34.303064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30358): Launched 09:12:34.562157 run iperf3-srv_10.42.42.10(pid=30359): Launched 09:12:34.673880 tst iperf3m4.py:8: start network... 09:12:34.873672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:35.336213 run create_hlr_db(pid=30360): Launched 09:12:35.450038 bus /gobi_6: Setting Powered False 09:12:36.509970 run create_hlr_db(pid=30360): Terminated: ok {rc=0} 09:12:36.925435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30362): Launched 09:12:37.224110 run osmo-hlr_10.42.42.2(pid=30363): Launched 09:12:37.338791 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:37.858029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30365): Launched 09:12:38.156883 run osmo-stp_10.42.42.5(pid=30366): Launched 09:12:38.271774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:38.788370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30368): Launched 09:12:38.903149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:39.155504 run patchelf(pid=30369): Launched 09:12:39.321625 run osmo-stp_10.42.42.5(pid=30366): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30366)] 09:12:39.448513 run osmo-stp_10.42.42.5(pid=30366): stdout: | (launched: 2022-12-13_09:12:38.102299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:39.577094 run osmo-stp_10.42.42.5(pid=30366): stderr: | 20221213091238274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091238274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091238274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091238274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091238275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091238275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091238275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:39.705338 run osmo-stp_10.42.42.5(pid=30366): stdout: | (launched: 2022-12-13_09:12:38.102299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:39.828054 run osmo-stp_10.42.42.5(pid=30366): stderr: | 20221213091238274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091238274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091238274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091238274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091238275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091238275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091238275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:39.973996 run patchelf(pid=30369): Terminating (SIGINT) 09:12:40.141756 run patchelf(pid=30369): Terminated: ok {rc=0} 09:12:40.262829 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30366): Process ended prematurely: osmo-stp_10.42.42.5(pid=30366) [trial-2387↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30366)] [trial-2387↪gprs:trx-umtrx↪iperf3m4.py:8] 09:12:40.272206 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:12:40.299290 run osmo-hlr_10.42.42.2(pid=30363): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30363)] 09:12:40.347565 run osmo-hlr_10.42.42.2(pid=30363): stdout: | (launched: 2022-12-13_09:12:37.169659) 09:12:40.397206 run osmo-hlr_10.42.42.2(pid=30363): stderr: | 20221213091237348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091237348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091237348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091237348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091237348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091237348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091237361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091237369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091237369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091237369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:40.447093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Terminating (SIGTERM) 09:12:40.487103 run iperf3-srv_10.42.42.10(pid=30353): Terminating (SIGTERM) 09:12:40.526873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30354): Terminating (SIGTERM) 09:12:40.566707 run iperf3-srv_10.42.42.10(pid=30355): Terminating (SIGTERM) 09:12:40.606587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30356): Terminating (SIGTERM) 09:12:40.646260 run iperf3-srv_10.42.42.10(pid=30357): Terminating (SIGTERM) 09:12:40.685796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30358): Terminating (SIGTERM) 09:12:40.725839 run iperf3-srv_10.42.42.10(pid=30359): Terminating (SIGTERM) 09:12:40.765408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30362): Terminating (SIGTERM) 09:12:40.805144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30365): Terminating (SIGTERM) 09:12:40.844547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30368): Terminating (SIGTERM) 09:12:40.884281 --- ParallelTerminationStrategy: PID 30352 died... 09:12:40.903591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30352): Terminated: ok {rc=0} 09:12:40.947340 --- ParallelTerminationStrategy: PID 30353 died... 09:12:40.966088 run iperf3-srv_10.42.42.10(pid=30353): Terminated {rc=256} 09:12:41.009505 --- ParallelTerminationStrategy: PID 30354 died... 09:12:41.028087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30354): Terminated: ok {rc=0} 09:12:41.071769 --- ParallelTerminationStrategy: PID 30355 died... 09:12:41.090373 run iperf3-srv_10.42.42.10(pid=30355): Terminated {rc=256} 09:12:41.133786 --- ParallelTerminationStrategy: PID 30356 died... 09:12:41.152361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30356): Terminated: ok {rc=0} 09:12:41.195781 --- ParallelTerminationStrategy: PID 30357 died... 09:12:41.214463 run iperf3-srv_10.42.42.10(pid=30357): Terminated {rc=256} 09:12:41.257768 --- ParallelTerminationStrategy: PID 30358 died... 09:12:41.276079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30358): Terminated: ok {rc=0} 09:12:41.319687 --- ParallelTerminationStrategy: PID 30359 died... 09:12:41.338383 run iperf3-srv_10.42.42.10(pid=30359): Terminated {rc=256} 09:12:41.381962 --- ParallelTerminationStrategy: PID 30362 died... 09:12:41.400581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30362): Terminated: ok {rc=0} 09:12:41.443901 --- ParallelTerminationStrategy: PID 30365 died... 09:12:41.462658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30365): Terminated: ok {rc=0} 09:12:41.506273 --- ParallelTerminationStrategy: PID 30368 died... 09:12:41.525143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30368): Terminated: ok {rc=0} 09:12:41.608664 bus /gobi_4: Setting Powered False 09:12:42.706029 bus /gobi_4: Setting Powered False 09:12:43.821505 bus /gobi_1: Setting Powered False 09:12:44.918405 bus /gobi_1: Setting Powered False 09:12:46.033937 bus /gobi_0: Setting Powered False 09:12:47.136459 bus /gobi_0: Setting Powered False 09:12:48.249281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx ping.py ---------------------------------------------- 09:12:49.351614 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.363304 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:12:49.413234 tst ping.py: using LAC 32944 09:12:49.537692 tst ping.py: using RAC 49 09:12:49.660734 tst ping.py: using CellId 32944 09:12:49.776828 tst ping.py: using BVCI 32945 09:12:49.883566 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.894636 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.905265 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.915739 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.926694 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.937461 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.948524 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:49.959546 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:50.079090 tst ping.py:19: start network... 09:12:50.289970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:50.775507 run create_hlr_db(pid=30370): Launched 09:12:50.902709 bus /gobi_6: Setting Powered False 09:12:51.970670 run create_hlr_db(pid=30370): Terminated: ok {rc=0} 09:12:52.407039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30372): Launched 09:12:52.718651 run osmo-hlr_10.42.42.2(pid=30373): Launched 09:12:52.838938 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:53.381786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30375): Launched 09:12:53.694506 run osmo-stp_10.42.42.5(pid=30376): Launched 09:12:53.813954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:54.353984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30378): Launched 09:12:54.474102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:54.739130 run patchelf(pid=30379): Launched 09:12:54.913767 run osmo-stp_10.42.42.5(pid=30376): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30376)] 09:12:55.046971 run osmo-stp_10.42.42.5(pid=30376): stdout: | (launched: 2022-12-13_09:12:53.637419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:55.181531 run osmo-stp_10.42.42.5(pid=30376): stderr: | 20221213091253826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091253826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091253826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091253827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091253828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091253828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091253828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:55.316916 run osmo-stp_10.42.42.5(pid=30376): stdout: | (launched: 2022-12-13_09:12:53.637419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:55.446699 run osmo-stp_10.42.42.5(pid=30376): stderr: | 20221213091253826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091253826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091253826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091253827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091253828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091253828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091253828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:55.599413 run patchelf(pid=30379): Terminating (SIGINT) 09:12:55.775123 run patchelf(pid=30379): Terminated: ok {rc=0} 09:12:55.901994 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30376): Process ended prematurely: osmo-stp_10.42.42.5(pid=30376) [trial-2387↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30376)] [trial-2387↪gprs:trx-umtrx↪ping.py:22] 09:12:55.911309 tst ping.py:22: Test FAILED (6.6 sec) 09:12:55.939048 run osmo-hlr_10.42.42.2(pid=30373): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30373)] 09:12:55.988489 run osmo-hlr_10.42.42.2(pid=30373): stdout: | (launched: 2022-12-13_09:12:52.662008) 09:12:56.039833 run osmo-hlr_10.42.42.2(pid=30373): stderr: | 20221213091252861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091252861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091252861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091252861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091252861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091252861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091252874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091252882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091252883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091252883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:56.091305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30372): Terminating (SIGTERM) 09:12:56.132349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30375): Terminating (SIGTERM) 09:12:56.173455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30378): Terminating (SIGTERM) 09:12:56.214845 --- ParallelTerminationStrategy: PID 30372 died... 09:12:56.234892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30372): Terminated: ok {rc=0} 09:12:56.280491 --- ParallelTerminationStrategy: PID 30375 died... 09:12:56.300186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30375): Terminated: ok {rc=0} 09:12:56.346101 --- ParallelTerminationStrategy: PID 30378 died... 09:12:56.365728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30378): Terminated: ok {rc=0} 09:12:56.451437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 09:12:57.537659 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:57.549369 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:12:57.599841 tst ping_idle_ping.py: using LAC 32945 09:12:57.725433 tst ping_idle_ping.py: using RAC 50 09:12:57.850955 tst ping_idle_ping.py: using CellId 32945 09:12:57.982349 tst ping_idle_ping.py: using BVCI 32946 09:12:58.097569 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:58.108653 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:58.119696 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:58.130593 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:58.141547 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:58.152334 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:58.163323 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:12:58.174379 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:12:58.287819 tst ping_idle_ping.py:24: start network... 09:12:58.485203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:58.942914 run create_hlr_db(pid=30380): Launched 09:12:59.055401 bus /gobi_6: Setting Powered False 09:13:00.114252 run create_hlr_db(pid=30380): Terminated: ok {rc=0} 09:13:00.545295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30382): Launched 09:13:00.868781 run osmo-hlr_10.42.42.2(pid=30383): Launched 09:13:01.091207 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:01.764405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30385): Launched 09:13:02.101697 run osmo-stp_10.42.42.5(pid=30386): Launched 09:13:02.220301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:02.848426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30388): Launched 09:13:02.961161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:03.209535 run patchelf(pid=30389): Launched 09:13:03.373430 run osmo-stp_10.42.42.5(pid=30386): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30386)] 09:13:03.498531 run osmo-stp_10.42.42.5(pid=30386): stdout: | (launched: 2022-12-13_09:13:02.037500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:03.625240 run osmo-stp_10.42.42.5(pid=30386): stderr: | 20221213091302376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091302376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091302376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091302376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091302377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091302377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091302377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:03.751907 run osmo-stp_10.42.42.5(pid=30386): stdout: | (launched: 2022-12-13_09:13:02.037500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:03.873518 run osmo-stp_10.42.42.5(pid=30386): stderr: | 20221213091302376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091302376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091302376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091302376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091302377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091302377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091302377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:04.017619 run patchelf(pid=30389): Terminating (SIGINT) 09:13:04.182916 run patchelf(pid=30389): Terminated: ok {rc=0} 09:13:04.301986 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30386): Process ended prematurely: osmo-stp_10.42.42.5(pid=30386) [trial-2387↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30386)] [trial-2387↪gprs:trx-umtrx↪ping_idle_ping.py:27] 09:13:04.310809 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 09:13:04.337466 run osmo-hlr_10.42.42.2(pid=30383): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30383)] 09:13:04.385647 run osmo-hlr_10.42.42.2(pid=30383): stdout: | (launched: 2022-12-13_09:13:00.802661) 09:13:04.435348 run osmo-hlr_10.42.42.2(pid=30383): stderr: | 20221213091301099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091301099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091301099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091301099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091301099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091301099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091301124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091301137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091301137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091301137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:04.485347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30382): Terminating (SIGTERM) 09:13:04.525483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30385): Terminating (SIGTERM) 09:13:04.565665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30388): Terminating (SIGTERM) 09:13:04.606217 --- ParallelTerminationStrategy: PID 30382 died... 09:13:04.626028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30382): Terminated: ok {rc=0} 09:13:04.670718 --- ParallelTerminationStrategy: PID 30385 died... 09:13:04.689670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30385): Terminated: ok {rc=0} 09:13:04.734039 --- ParallelTerminationStrategy: PID 30388 died... 09:13:04.753187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30388): Terminated: ok {rc=0} 09:13:04.839027 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 09:13:06.147512 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:06.153376 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:13:06.186375 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:13:06.226403 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:13:06.313812 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:13:06.347135 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:13:06.387092 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:13:06.976464 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:13:07.025941 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.036610 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:13:07.084225 tst cs_paging_gprs_active.py: using LAC 32946 09:13:07.201116 tst cs_paging_gprs_active.py: using RAC 51 09:13:07.317363 tst cs_paging_gprs_active.py: using CellId 32946 09:13:07.433730 tst cs_paging_gprs_active.py: using BVCI 32947 09:13:07.544336 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.555461 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.566373 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.577266 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.588505 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.599771 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.611225 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.622662 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:07.634168 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:07.752571 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:07.869550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:13:08.071704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:08.372303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30394): Launched 09:13:08.632178 run iperf3-srv_10.42.42.10(pid=30395): Launched 09:13:08.744402 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:13:08.944905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:09.245607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30396): Launched 09:13:09.506047 run iperf3-srv_10.42.42.10(pid=30397): Launched 09:13:09.618697 tst cs_paging_gprs_active.py:38: start network... 09:13:09.819157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:10.282290 run create_hlr_db(pid=30398): Launched 09:13:10.396572 bus /gobi_6: Setting Powered False 09:13:11.456891 run create_hlr_db(pid=30398): Terminated: ok {rc=0} 09:13:11.894526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30400): Launched 09:13:12.214171 run osmo-hlr_10.42.42.2(pid=30401): Launched 09:13:12.337645 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:12.888686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30403): Launched 09:13:13.208031 run osmo-stp_10.42.42.5(pid=30404): Launched 09:13:13.332731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:13.884211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30406): Launched 09:13:14.005633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:14.275171 run patchelf(pid=30407): Launched 09:13:14.453317 run osmo-stp_10.42.42.5(pid=30404): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30404)] 09:13:14.588729 run osmo-stp_10.42.42.5(pid=30404): stdout: | (launched: 2022-12-13_09:13:13.150181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:14.725894 run osmo-stp_10.42.42.5(pid=30404): stderr: | 20221213091313343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091313343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091313343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091313343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091313344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091313344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091313344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:14.862868 run osmo-stp_10.42.42.5(pid=30404): stdout: | (launched: 2022-12-13_09:13:13.150181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:14.993683 run osmo-stp_10.42.42.5(pid=30404): stderr: | 20221213091313343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091313343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091313343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091313343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091313344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091313344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091313344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:15.149371 run patchelf(pid=30407): Terminating (SIGINT) 09:13:15.329333 run patchelf(pid=30407): Terminated: ok {rc=0} 09:13:15.459244 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30404): Process ended prematurely: osmo-stp_10.42.42.5(pid=30404) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30404)] [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:13:15.469242 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:13:15.497377 run osmo-hlr_10.42.42.2(pid=30401): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30401)] 09:13:15.546733 run osmo-hlr_10.42.42.2(pid=30401): stdout: | (launched: 2022-12-13_09:13:12.156211) 09:13:15.597895 run osmo-hlr_10.42.42.2(pid=30401): stderr: | 20221213091312355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091312355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091312355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091312355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091312355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091312355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091312367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091312377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091312378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091312378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:15.649437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30394): Terminating (SIGTERM) 09:13:15.690649 run iperf3-srv_10.42.42.10(pid=30395): Terminating (SIGTERM) 09:13:15.731884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30396): Terminating (SIGTERM) 09:13:15.773294 run iperf3-srv_10.42.42.10(pid=30397): Terminating (SIGTERM) 09:13:15.814597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30400): Terminating (SIGTERM) 09:13:15.866707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30403): Terminating (SIGTERM) 09:13:15.917889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30406): Terminating (SIGTERM) 09:13:15.959943 --- ParallelTerminationStrategy: PID 30394 died... 09:13:15.979886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30394): Terminated: ok {rc=0} 09:13:16.026366 --- ParallelTerminationStrategy: PID 30395 died... 09:13:16.047002 run iperf3-srv_10.42.42.10(pid=30395): Terminated {rc=256} 09:13:16.098136 --- ParallelTerminationStrategy: PID 30396 died... 09:13:16.118117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30396): Terminated: ok {rc=0} 09:13:16.163948 --- ParallelTerminationStrategy: PID 30397 died... 09:13:16.184265 run iperf3-srv_10.42.42.10(pid=30397): Terminated {rc=256} 09:13:16.230120 --- ParallelTerminationStrategy: PID 30400 died... 09:13:16.251992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30400): Terminated: ok {rc=0} 09:13:16.297945 --- ParallelTerminationStrategy: PID 30403 died... 09:13:16.318389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30403): Terminated: ok {rc=0} 09:13:16.364688 --- ParallelTerminationStrategy: PID 30406 died... 09:13:16.385077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30406): Terminated: ok {rc=0} 09:13:16.472399 bus /gobi_0: Setting Powered False 09:13:17.568176 bus /gobi_0: Setting Powered False 09:13:18.682387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:13:19.826302 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:19.837887 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:13:19.890243 tst iperf3.py: using LAC 32947 09:13:20.009358 tst iperf3.py: using RAC 52 09:13:20.126992 tst iperf3.py: using CellId 32947 09:13:20.246434 tst iperf3.py: using BVCI 32948 09:13:20.357382 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.368341 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.379197 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.390089 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.401409 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.412521 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.423870 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.435103 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:20.446631 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:20.566859 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:13:20.783355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:21.103552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30408): Launched 09:13:21.381386 run iperf3-srv_10.42.42.10(pid=30409): Launched 09:13:21.501536 tst iperf3.py:8: start network... 09:13:21.717421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:22.210557 run create_hlr_db(pid=30410): Launched 09:13:22.340439 bus /gobi_6: Setting Powered False 09:13:23.403581 run create_hlr_db(pid=30410): Terminated: ok {rc=0} 09:13:23.828827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30412): Launched 09:13:24.126537 run osmo-hlr_10.42.42.2(pid=30413): Launched 09:13:24.240813 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:24.760561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30415): Launched 09:13:25.057876 run osmo-stp_10.42.42.5(pid=30416): Launched 09:13:25.171620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:25.685908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30418): Launched 09:13:25.800173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:26.052078 run patchelf(pid=30419): Launched 09:13:26.218745 run osmo-stp_10.42.42.5(pid=30416): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30416)] 09:13:26.345956 run osmo-stp_10.42.42.5(pid=30416): stdout: | (launched: 2022-12-13_09:13:25.003687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:26.474356 run osmo-stp_10.42.42.5(pid=30416): stderr: | 20221213091325171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091325171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091325172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091325172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091325173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091325173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091325173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:26.602837 run osmo-stp_10.42.42.5(pid=30416): stdout: | (launched: 2022-12-13_09:13:25.003687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:26.725596 run osmo-stp_10.42.42.5(pid=30416): stderr: | 20221213091325171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091325171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091325172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091325172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091325173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091325173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091325173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:26.870843 run patchelf(pid=30419): Terminating (SIGINT) 09:13:27.038738 run patchelf(pid=30419): Terminated: ok {rc=0} 09:13:27.160346 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30416): Process ended prematurely: osmo-stp_10.42.42.5(pid=30416) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30416)] [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 09:13:27.170121 tst iperf3.py:8: Test FAILED (7.4 sec) 09:13:27.197131 run osmo-hlr_10.42.42.2(pid=30413): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30413)] 09:13:27.245481 run osmo-hlr_10.42.42.2(pid=30413): stdout: | (launched: 2022-12-13_09:13:24.072653) 09:13:27.294729 run osmo-hlr_10.42.42.2(pid=30413): stderr: | 20221213091324249 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091324249 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091324249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091324249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091324249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091324249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091324261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091324269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091324270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091324270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:27.344553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30408): Terminating (SIGTERM) 09:13:27.384416 run iperf3-srv_10.42.42.10(pid=30409): Terminating (SIGTERM) 09:13:27.423934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30412): Terminating (SIGTERM) 09:13:27.463540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30415): Terminating (SIGTERM) 09:13:27.503379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30418): Terminating (SIGTERM) 09:13:27.543361 --- ParallelTerminationStrategy: PID 30408 died... 09:13:27.562912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30408): Terminated: ok {rc=0} 09:13:27.606988 --- ParallelTerminationStrategy: PID 30409 died... 09:13:27.626029 run iperf3-srv_10.42.42.10(pid=30409): Terminated {rc=256} 09:13:27.669871 --- ParallelTerminationStrategy: PID 30412 died... 09:13:27.689021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30412): Terminated: ok {rc=0} 09:13:27.733137 --- ParallelTerminationStrategy: PID 30415 died... 09:13:27.752169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30415): Terminated: ok {rc=0} 09:13:27.796142 --- ParallelTerminationStrategy: PID 30418 died... 09:13:27.815280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30418): Terminated: ok {rc=0} 09:13:27.900788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:13:29.044913 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.056397 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:13:29.106581 tst iperf3m4.py: using LAC 32948 09:13:29.225379 tst iperf3m4.py: using RAC 53 09:13:29.342202 tst iperf3m4.py: using CellId 32948 09:13:29.472559 tst iperf3m4.py: using BVCI 32949 09:13:29.591599 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.603166 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.614478 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.625913 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.637388 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.648646 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.659945 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.671135 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:29.682490 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:29.798962 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:29.918363 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:30.033877 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:30.149331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:13:30.350233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:30.650171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30420): Launched 09:13:30.941373 run iperf3-srv_10.42.42.10(pid=30421): Launched 09:13:31.081122 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:13:31.304130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:31.638486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30422): Launched 09:13:31.941738 run iperf3-srv_10.42.42.10(pid=30423): Launched 09:13:32.067875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:13:32.271568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:32.571835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30424): Launched 09:13:32.831025 run iperf3-srv_10.42.42.10(pid=30425): Launched 09:13:32.943078 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:13:33.143148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:33.442431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30426): Launched 09:13:33.721946 run iperf3-srv_10.42.42.10(pid=30427): Launched 09:13:33.842378 tst iperf3m4.py:8: start network... 09:13:34.058218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:34.554129 run create_hlr_db(pid=30428): Launched 09:13:34.683904 bus /gobi_6: Setting Powered False 09:13:35.747907 run create_hlr_db(pid=30428): Terminated: ok {rc=0} 09:13:36.192680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30430): Launched 09:13:36.512676 run osmo-hlr_10.42.42.2(pid=30431): Launched 09:13:36.634552 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:37.189815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30433): Launched 09:13:37.509829 run osmo-stp_10.42.42.5(pid=30434): Launched 09:13:37.627300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:38.145257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30436): Launched 09:13:38.260068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:38.512671 run patchelf(pid=30437): Launched 09:13:38.679862 run osmo-stp_10.42.42.5(pid=30434): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30434)] 09:13:38.806995 run osmo-stp_10.42.42.5(pid=30434): stdout: | (launched: 2022-12-13_09:13:37.451850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:38.935776 run osmo-stp_10.42.42.5(pid=30434): stderr: | 20221213091337629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091337629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091337630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091337630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091337631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091337631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091337631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:39.064783 run osmo-stp_10.42.42.5(pid=30434): stdout: | (launched: 2022-12-13_09:13:37.451850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:39.187909 run osmo-stp_10.42.42.5(pid=30434): stderr: | 20221213091337629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091337629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091337630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091337630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091337631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091337631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091337631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:39.334108 run patchelf(pid=30437): Terminating (SIGINT) 09:13:39.503178 run patchelf(pid=30437): Terminated: ok {rc=0} 09:13:39.625969 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30434): Process ended prematurely: osmo-stp_10.42.42.5(pid=30434) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30434)] [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 09:13:39.635505 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:13:39.662673 run osmo-hlr_10.42.42.2(pid=30431): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30431)] 09:13:39.710376 run osmo-hlr_10.42.42.2(pid=30431): stdout: | (launched: 2022-12-13_09:13:36.454905) 09:13:39.760320 run osmo-hlr_10.42.42.2(pid=30431): stderr: | 20221213091336654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091336654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091336654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091336654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091336654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091336654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091336667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091336675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091336676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091336676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:39.810226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30420): Terminating (SIGTERM) 09:13:39.850548 run iperf3-srv_10.42.42.10(pid=30421): Terminating (SIGTERM) 09:13:39.890831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30422): Terminating (SIGTERM) 09:13:39.931187 run iperf3-srv_10.42.42.10(pid=30423): Terminating (SIGTERM) 09:13:39.971599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30424): Terminating (SIGTERM) 09:13:40.012117 run iperf3-srv_10.42.42.10(pid=30425): Terminating (SIGTERM) 09:13:40.052703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30426): Terminating (SIGTERM) 09:13:40.092863 run iperf3-srv_10.42.42.10(pid=30427): Terminating (SIGTERM) 09:13:40.132737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30430): Terminating (SIGTERM) 09:13:40.172772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30433): Terminating (SIGTERM) 09:13:40.212836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30436): Terminating (SIGTERM) 09:13:40.253233 --- ParallelTerminationStrategy: PID 30420 died... 09:13:40.273038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30420): Terminated: ok {rc=0} 09:13:40.317472 --- ParallelTerminationStrategy: PID 30421 died... 09:13:40.336559 run iperf3-srv_10.42.42.10(pid=30421): Terminated {rc=256} 09:13:40.380896 --- ParallelTerminationStrategy: PID 30422 died... 09:13:40.400282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30422): Terminated: ok {rc=0} 09:13:40.444732 --- ParallelTerminationStrategy: PID 30423 died... 09:13:40.464041 run iperf3-srv_10.42.42.10(pid=30423): Terminated {rc=256} 09:13:40.508193 --- ParallelTerminationStrategy: PID 30424 died... 09:13:40.527601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30424): Terminated: ok {rc=0} 09:13:40.572127 --- ParallelTerminationStrategy: PID 30425 died... 09:13:40.591475 run iperf3-srv_10.42.42.10(pid=30425): Terminated {rc=256} 09:13:40.635865 --- ParallelTerminationStrategy: PID 30426 died... 09:13:40.655329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30426): Terminated: ok {rc=0} 09:13:40.699929 --- ParallelTerminationStrategy: PID 30427 died... 09:13:40.719370 run iperf3-srv_10.42.42.10(pid=30427): Terminated {rc=256} 09:13:40.763645 --- ParallelTerminationStrategy: PID 30430 died... 09:13:40.783088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30430): Terminated: ok {rc=0} 09:13:40.827588 --- ParallelTerminationStrategy: PID 30433 died... 09:13:40.847162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30433): Terminated: ok {rc=0} 09:13:40.891631 --- ParallelTerminationStrategy: PID 30436 died... 09:13:40.911071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30436): Terminated: ok {rc=0} 09:13:40.997858 bus /gobi_4: Setting Powered False 09:13:42.097871 bus /gobi_4: Setting Powered False 09:13:43.213391 bus /gobi_1: Setting Powered False 09:13:44.310807 bus /gobi_1: Setting Powered False 09:13:45.421577 bus /gobi_0: Setting Powered False 09:13:46.518658 bus /gobi_0: Setting Powered False 09:13:47.637708 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 09:13:48.737240 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:48.748687 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:13:48.798606 tst ping.py: using LAC 32949 09:13:48.915339 tst ping.py: using RAC 54 09:13:49.030564 tst ping.py: using CellId 32949 09:13:49.147348 tst ping.py: using BVCI 32950 09:13:49.253975 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:49.265067 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:49.275994 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:49.286763 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:49.297929 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:49.309065 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:49.320442 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:49.331547 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:49.451236 tst ping.py:19: start network... 09:13:49.663196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:50.150815 run create_hlr_db(pid=30438): Launched 09:13:50.278978 bus /gobi_6: Setting Powered False 09:13:51.342431 run create_hlr_db(pid=30438): Terminated: ok {rc=0} 09:13:51.781230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30440): Launched 09:13:52.094742 run osmo-hlr_10.42.42.2(pid=30441): Launched 09:13:52.214292 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:52.759636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30443): Launched 09:13:53.072155 run osmo-stp_10.42.42.5(pid=30444): Launched 09:13:53.191618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:53.733391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30446): Launched 09:13:53.853295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:54.118125 run patchelf(pid=30447): Launched 09:13:54.292912 run osmo-stp_10.42.42.5(pid=30444): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30444)] 09:13:54.427057 run osmo-stp_10.42.42.5(pid=30444): stdout: | (launched: 2022-12-13_09:13:53.015307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:54.562066 run osmo-stp_10.42.42.5(pid=30444): stderr: | 20221213091353206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091353206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091353206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091353207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091353207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091353207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091353207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:54.696799 run osmo-stp_10.42.42.5(pid=30444): stdout: | (launched: 2022-12-13_09:13:53.015307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:54.826084 run osmo-stp_10.42.42.5(pid=30444): stderr: | 20221213091353206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091353206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091353206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091353207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091353207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091353207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091353207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:54.978833 run patchelf(pid=30447): Terminating (SIGINT) 09:13:55.154795 run patchelf(pid=30447): Terminated: ok {rc=0} 09:13:55.282000 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30444): Process ended prematurely: osmo-stp_10.42.42.5(pid=30444) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30444)] [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 09:13:55.291437 tst ping.py:22: Test FAILED (6.5 sec) 09:13:55.319455 run osmo-hlr_10.42.42.2(pid=30441): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30441)] 09:13:55.370106 run osmo-hlr_10.42.42.2(pid=30441): stdout: | (launched: 2022-12-13_09:13:52.038060) 09:13:55.421913 run osmo-hlr_10.42.42.2(pid=30441): stderr: | 20221213091352235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091352235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091352235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091352235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091352235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091352235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091352248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091352257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091352257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091352257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:55.473770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30440): Terminating (SIGTERM) 09:13:55.515775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30443): Terminating (SIGTERM) 09:13:55.557892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30446): Terminating (SIGTERM) 09:13:55.600447 --- ParallelTerminationStrategy: PID 30440 died... 09:13:55.620851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30440): Terminated: ok {rc=0} 09:13:55.667363 --- ParallelTerminationStrategy: PID 30443 died... 09:13:55.687180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30443): Terminated: ok {rc=0} 09:13:55.734015 --- ParallelTerminationStrategy: PID 30446 died... 09:13:55.754026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30446): Terminated: ok {rc=0} 09:13:55.841560 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:13:56.928594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:56.940650 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:13:56.991591 tst ping_idle_ping.py: using LAC 32950 09:13:57.109067 tst ping_idle_ping.py: using RAC 55 09:13:57.224352 tst ping_idle_ping.py: using CellId 32950 09:13:57.340432 tst ping_idle_ping.py: using BVCI 32951 09:13:57.446982 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:57.458390 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:57.469631 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:57.480285 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:57.492467 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:57.503841 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:57.515092 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:57.526292 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:57.639134 tst ping_idle_ping.py:24: start network... 09:13:57.837511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:58.296157 run create_hlr_db(pid=30448): Launched 09:13:58.408310 bus /gobi_6: Setting Powered False 09:13:59.468245 run create_hlr_db(pid=30448): Terminated: ok {rc=0} 09:13:59.900876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30450): Launched 09:14:00.217407 run osmo-hlr_10.42.42.2(pid=30451): Launched 09:14:00.339423 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:00.921500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30453): Launched 09:14:01.262755 run osmo-stp_10.42.42.5(pid=30454): Launched 09:14:01.515633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:02.223308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30456): Launched 09:14:02.346064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:02.596553 run patchelf(pid=30457): Launched 09:14:02.760441 run osmo-stp_10.42.42.5(pid=30454): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30454)] 09:14:02.886116 run osmo-stp_10.42.42.5(pid=30454): stdout: | (launched: 2022-12-13_09:14:01.200586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:03.013246 run osmo-stp_10.42.42.5(pid=30454): stderr: | 20221213091401564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091401564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091401573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091401573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091401574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091401574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091401574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:03.141393 run osmo-stp_10.42.42.5(pid=30454): stdout: | (launched: 2022-12-13_09:14:01.200586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:03.263471 run osmo-stp_10.42.42.5(pid=30454): stderr: | 20221213091401564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091401564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091401573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091401573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091401574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091401574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091401574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:03.408071 run patchelf(pid=30457): Terminating (SIGINT) 09:14:03.573711 run patchelf(pid=30457): Terminated: ok {rc=0} 09:14:03.693855 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30454): Process ended prematurely: osmo-stp_10.42.42.5(pid=30454) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30454)] [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 09:14:03.702748 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 09:14:03.729422 run osmo-hlr_10.42.42.2(pid=30451): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30451)] 09:14:03.777392 run osmo-hlr_10.42.42.2(pid=30451): stdout: | (launched: 2022-12-13_09:14:00.159800) 09:14:03.826710 run osmo-hlr_10.42.42.2(pid=30451): stderr: | 20221213091400358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091400358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091400358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091400358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091400358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091400358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091400368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091400377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091400377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091400377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:03.876443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30450): Terminating (SIGTERM) 09:14:03.916450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30453): Terminating (SIGTERM) 09:14:03.956464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30456): Terminating (SIGTERM) 09:14:03.996652 --- ParallelTerminationStrategy: PID 30450 died... 09:14:04.016263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30450): Terminated: ok {rc=0} 09:14:04.061155 --- ParallelTerminationStrategy: PID 30453 died... 09:14:04.080265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30453): Terminated: ok {rc=0} 09:14:04.124449 --- ParallelTerminationStrategy: PID 30456 died... 09:14:04.143447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30456): Terminated: ok {rc=0} 09:14:04.227317 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:14:05.531420 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:14:05.538709 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:14:05.572165 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:14:05.613101 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:14:05.703389 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:14:05.736536 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:14:05.776162 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:14:06.369931 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:14:06.421703 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:06.432924 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:14:06.501784 tst cs_paging_gprs_active.py: using LAC 32951 09:14:06.619928 tst cs_paging_gprs_active.py: using RAC 56 09:14:06.745418 tst cs_paging_gprs_active.py: using CellId 32951 09:14:06.871730 tst cs_paging_gprs_active.py: using BVCI 32952 09:14:06.990001 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.001372 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.012541 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.023780 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.034842 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.046011 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.057226 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.068265 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:07.079523 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:07.197618 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:07.316779 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:14:07.533584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:07.857761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30465): Launched 09:14:08.119756 run iperf3-srv_10.42.42.10(pid=30466): Launched 09:14:08.232851 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:14:08.434713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:08.734988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30467): Launched 09:14:08.994441 run iperf3-srv_10.42.42.10(pid=30468): Launched 09:14:09.106628 tst cs_paging_gprs_active.py:38: start network... 09:14:09.307072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:09.769966 run create_hlr_db(pid=30469): Launched 09:14:09.885071 bus /gobi_6: Setting Powered False 09:14:10.944744 run create_hlr_db(pid=30469): Terminated: ok {rc=0} 09:14:11.360434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30471): Launched 09:14:11.660150 run osmo-hlr_10.42.42.2(pid=30472): Launched 09:14:11.775262 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:12.288804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30474): Launched 09:14:12.588292 run osmo-stp_10.42.42.5(pid=30475): Launched 09:14:12.703380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:13.219114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30477): Launched 09:14:13.333703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:13.592903 run patchelf(pid=30478): Launched 09:14:13.759936 run osmo-stp_10.42.42.5(pid=30475): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30475)] 09:14:13.888083 run osmo-stp_10.42.42.5(pid=30475): stdout: | (launched: 2022-12-13_09:14:12.533560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:14.017306 run osmo-stp_10.42.42.5(pid=30475): stderr: | 20221213091412705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091412705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091412705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091412706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091412706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091412706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091412706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:14.146547 run osmo-stp_10.42.42.5(pid=30475): stdout: | (launched: 2022-12-13_09:14:12.533560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:14.270152 run osmo-stp_10.42.42.5(pid=30475): stderr: | 20221213091412705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091412705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091412705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091412706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091412706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091412706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091412706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:14.416475 run patchelf(pid=30478): Terminating (SIGINT) 09:14:14.585580 run patchelf(pid=30478): Terminated: ok {rc=0} 09:14:14.707173 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30475): Process ended prematurely: osmo-stp_10.42.42.5(pid=30475) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30475)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:14:14.716623 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 09:14:14.743438 run osmo-hlr_10.42.42.2(pid=30472): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30472)] 09:14:14.791106 run osmo-hlr_10.42.42.2(pid=30472): stdout: | (launched: 2022-12-13_09:14:11.604789) 09:14:14.840509 run osmo-hlr_10.42.42.2(pid=30472): stderr: | 20221213091411780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091411780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091411780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091411780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091411780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091411780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091411792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091411801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091411802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091411802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:14.890109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30465): Terminating (SIGTERM) 09:14:14.929854 run iperf3-srv_10.42.42.10(pid=30466): Terminating (SIGTERM) 09:14:14.969453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30467): Terminating (SIGTERM) 09:14:15.009188 run iperf3-srv_10.42.42.10(pid=30468): Terminating (SIGTERM) 09:14:15.048564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30471): Terminating (SIGTERM) 09:14:15.088197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30474): Terminating (SIGTERM) 09:14:15.128027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30477): Terminating (SIGTERM) 09:14:15.167985 --- ParallelTerminationStrategy: PID 30465 died... 09:14:15.187365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30465): Terminated: ok {rc=0} 09:14:15.231286 --- ParallelTerminationStrategy: PID 30466 died... 09:14:15.249871 run iperf3-srv_10.42.42.10(pid=30466): Terminated {rc=256} 09:14:15.293822 --- ParallelTerminationStrategy: PID 30467 died... 09:14:15.312769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30467): Terminated: ok {rc=0} 09:14:15.356522 --- ParallelTerminationStrategy: PID 30468 died... 09:14:15.375323 run iperf3-srv_10.42.42.10(pid=30468): Terminated {rc=256} 09:14:15.419183 --- ParallelTerminationStrategy: PID 30471 died... 09:14:15.438083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30471): Terminated: ok {rc=0} 09:14:15.482129 --- ParallelTerminationStrategy: PID 30474 died... 09:14:15.501103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30474): Terminated: ok {rc=0} 09:14:15.544788 --- ParallelTerminationStrategy: PID 30477 died... 09:14:15.564068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30477): Terminated: ok {rc=0} 09:14:15.646742 bus /gobi_0: Setting Powered False 09:14:16.741417 bus /gobi_0: Setting Powered False 09:14:17.855480 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:14:18.996148 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.007556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:14:19.075432 tst iperf3.py: using LAC 32952 09:14:19.193545 tst iperf3.py: using RAC 57 09:14:19.321143 tst iperf3.py: using CellId 32952 09:14:19.448460 tst iperf3.py: using BVCI 32953 09:14:19.566395 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.577843 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.589020 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.600101 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.611159 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.622326 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.633551 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.644512 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:19.655789 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:19.771679 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:14:19.974247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:20.274541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30479): Launched 09:14:20.534264 run iperf3-srv_10.42.42.10(pid=30480): Launched 09:14:20.646638 tst iperf3.py:8: start network... 09:14:20.847117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:21.310033 run create_hlr_db(pid=30481): Launched 09:14:21.424181 bus /gobi_6: Setting Powered False 09:14:22.484244 run create_hlr_db(pid=30481): Terminated: ok {rc=0} 09:14:22.920119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30483): Launched 09:14:23.239640 run osmo-hlr_10.42.42.2(pid=30484): Launched 09:14:23.362584 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:24.002543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30486): Launched 09:14:24.313684 run osmo-stp_10.42.42.5(pid=30487): Launched 09:14:24.433712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:24.973100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30489): Launched 09:14:25.091737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:25.355492 run patchelf(pid=30490): Launched 09:14:25.528749 run osmo-stp_10.42.42.5(pid=30487): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30487)] 09:14:25.661210 run osmo-stp_10.42.42.5(pid=30487): stdout: | (launched: 2022-12-13_09:14:24.256676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:25.794872 run osmo-stp_10.42.42.5(pid=30487): stderr: | 20221213091424447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091424447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091424447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091424448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091424448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091424448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091424448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:25.928469 run osmo-stp_10.42.42.5(pid=30487): stdout: | (launched: 2022-12-13_09:14:24.256676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:26.057350 run osmo-stp_10.42.42.5(pid=30487): stderr: | 20221213091424447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091424447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091424447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091424448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091424448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091424448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091424448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:26.209270 run patchelf(pid=30490): Terminating (SIGINT) 09:14:26.383783 run patchelf(pid=30490): Terminated: ok {rc=0} 09:14:26.509983 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30487): Process ended prematurely: osmo-stp_10.42.42.5(pid=30487) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30487)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 09:14:26.520030 tst iperf3.py:8: Test FAILED (7.6 sec) 09:14:26.548289 run osmo-hlr_10.42.42.2(pid=30484): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30484)] 09:14:26.597716 run osmo-hlr_10.42.42.2(pid=30484): stdout: | (launched: 2022-12-13_09:14:23.181985) 09:14:26.648769 run osmo-hlr_10.42.42.2(pid=30484): stderr: | 20221213091423379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091423379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091423379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091423379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091423379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091423379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091423394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091423402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091423403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091423403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:26.700171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30479): Terminating (SIGTERM) 09:14:26.741154 run iperf3-srv_10.42.42.10(pid=30480): Terminating (SIGTERM) 09:14:26.782542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30483): Terminating (SIGTERM) 09:14:26.824591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30486): Terminating (SIGTERM) 09:14:26.866430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30489): Terminating (SIGTERM) 09:14:26.908071 --- ParallelTerminationStrategy: PID 30479 died... 09:14:26.928175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30479): Terminated: ok {rc=0} 09:14:26.974016 --- ParallelTerminationStrategy: PID 30480 died... 09:14:26.993278 run iperf3-srv_10.42.42.10(pid=30480): Terminated {rc=256} 09:14:27.038784 --- ParallelTerminationStrategy: PID 30483 died... 09:14:27.058374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30483): Terminated: ok {rc=0} 09:14:27.103882 --- ParallelTerminationStrategy: PID 30486 died... 09:14:27.123263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30486): Terminated: ok {rc=0} 09:14:27.168706 --- ParallelTerminationStrategy: PID 30489 died... 09:14:27.188002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30489): Terminated: ok {rc=0} 09:14:27.274581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:14:28.418881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:28.430206 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:14:28.501439 tst iperf3m4.py: using LAC 32953 09:14:28.619728 tst iperf3m4.py: using RAC 58 09:14:28.732930 tst iperf3m4.py: using CellId 32953 09:14:28.851586 tst iperf3m4.py: using BVCI 32954 09:14:28.958699 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:28.969538 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:28.980064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:28.990593 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:29.001490 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:29.012261 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:29.023175 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:29.033996 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:29.044813 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:29.158477 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:29.277304 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:29.396151 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:29.511606 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:14:29.708604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:30.001735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30491): Launched 09:14:30.257395 run iperf3-srv_10.42.42.10(pid=30492): Launched 09:14:30.367157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:14:30.562543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:30.865733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30493): Launched 09:14:31.163320 run iperf3-srv_10.42.42.10(pid=30494): Launched 09:14:31.286102 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:14:31.486366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:31.791612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30495): Launched 09:14:32.069772 run iperf3-srv_10.42.42.10(pid=30496): Launched 09:14:32.188205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:14:32.387152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:32.680315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30498): Launched 09:14:32.933314 run iperf3-srv_10.42.42.10(pid=30499): Launched 09:14:33.042449 tst iperf3m4.py:8: start network... 09:14:33.237244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:33.689838 run create_hlr_db(pid=30500): Launched 09:14:33.801197 bus /gobi_6: Setting Powered False 09:14:34.860507 run create_hlr_db(pid=30500): Terminated: ok {rc=0} 09:14:35.268937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30502): Launched 09:14:35.560110 run osmo-hlr_10.42.42.2(pid=30503): Launched 09:14:35.672162 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:36.188016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30505): Launched 09:14:36.479599 run osmo-stp_10.42.42.5(pid=30506): Launched 09:14:36.591524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:37.094668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30508): Launched 09:14:37.206117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:37.452706 run patchelf(pid=30509): Launched 09:14:37.615301 run osmo-stp_10.42.42.5(pid=30506): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30506)] 09:14:37.739223 run osmo-stp_10.42.42.5(pid=30506): stdout: | (launched: 2022-12-13_09:14:36.426159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:37.864632 run osmo-stp_10.42.42.5(pid=30506): stderr: | 20221213091436595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091436595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091436595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091436596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091436596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091436596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091436596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:37.990282 run osmo-stp_10.42.42.5(pid=30506): stdout: | (launched: 2022-12-13_09:14:36.426159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:38.111448 run osmo-stp_10.42.42.5(pid=30506): stderr: | 20221213091436595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091436595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091436595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091436596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091436596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091436596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091436596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:38.254217 run patchelf(pid=30509): Terminating (SIGINT) 09:14:38.418680 run patchelf(pid=30509): Terminated: ok {rc=0} 09:14:38.537234 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30506): Process ended prematurely: osmo-stp_10.42.42.5(pid=30506) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30506)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:14:38.546615 tst iperf3m4.py:8: Test FAILED (10.2 sec) 09:14:38.573623 run osmo-hlr_10.42.42.2(pid=30503): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30503)] 09:14:38.621131 run osmo-hlr_10.42.42.2(pid=30503): stdout: | (launched: 2022-12-13_09:14:35.507023) 09:14:38.670046 run osmo-hlr_10.42.42.2(pid=30503): stderr: | 20221213091435682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091435682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091435682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091435682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091435682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091435682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091435694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091435702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091435703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091435703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:38.719281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30491): Terminating (SIGTERM) 09:14:38.759107 run iperf3-srv_10.42.42.10(pid=30492): Terminating (SIGTERM) 09:14:38.798905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30493): Terminating (SIGTERM) 09:14:38.839120 run iperf3-srv_10.42.42.10(pid=30494): Terminating (SIGTERM) 09:14:38.878949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30495): Terminating (SIGTERM) 09:14:38.918801 run iperf3-srv_10.42.42.10(pid=30496): Terminating (SIGTERM) 09:14:38.958520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30498): Terminating (SIGTERM) 09:14:38.998269 run iperf3-srv_10.42.42.10(pid=30499): Terminating (SIGTERM) 09:14:39.037901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30502): Terminating (SIGTERM) 09:14:39.077829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30505): Terminating (SIGTERM) 09:14:39.117575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30508): Terminating (SIGTERM) 09:14:39.157627 --- ParallelTerminationStrategy: PID 30491 died... 09:14:39.176894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30491): Terminated: ok {rc=0} 09:14:39.221123 --- ParallelTerminationStrategy: PID 30492 died... 09:14:39.239730 run iperf3-srv_10.42.42.10(pid=30492): Terminated {rc=256} 09:14:39.283845 --- ParallelTerminationStrategy: PID 30493 died... 09:14:39.302581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30493): Terminated: ok {rc=0} 09:14:39.346434 --- ParallelTerminationStrategy: PID 30494 died... 09:14:39.365211 run iperf3-srv_10.42.42.10(pid=30494): Terminated {rc=256} 09:14:39.409127 --- ParallelTerminationStrategy: PID 30495 died... 09:14:39.427839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30495): Terminated: ok {rc=0} 09:14:39.471712 --- ParallelTerminationStrategy: PID 30496 died... 09:14:39.490427 run iperf3-srv_10.42.42.10(pid=30496): Terminated {rc=256} 09:14:39.534271 --- ParallelTerminationStrategy: PID 30498 died... 09:14:39.553045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30498): Terminated: ok {rc=0} 09:14:39.596846 --- ParallelTerminationStrategy: PID 30499 died... 09:14:39.616066 run iperf3-srv_10.42.42.10(pid=30499): Terminated {rc=256} 09:14:39.659971 --- ParallelTerminationStrategy: PID 30502 died... 09:14:39.678637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30502): Terminated: ok {rc=0} 09:14:39.722095 --- ParallelTerminationStrategy: PID 30505 died... 09:14:39.740782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30505): Terminated: ok {rc=0} 09:14:39.784269 --- ParallelTerminationStrategy: PID 30508 died... 09:14:39.803112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30508): Terminated: ok {rc=0} 09:14:39.888221 bus /gobi_4: Setting Powered False 09:14:40.986524 bus /gobi_4: Setting Powered False 09:14:42.099417 bus /gobi_1: Setting Powered False 09:14:43.197512 bus /gobi_1: Setting Powered False 09:14:44.311195 bus /gobi_0: Setting Powered False 09:14:45.407641 bus /gobi_0: Setting Powered False 09:14:46.522383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:14:47.621423 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:47.632603 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:14:47.701615 tst ping.py: using LAC 32954 09:14:47.824389 tst ping.py: using RAC 59 09:14:47.947405 tst ping.py: using CellId 32954 09:14:48.061992 tst ping.py: using BVCI 32955 09:14:48.168761 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:48.179648 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:48.190472 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:48.201232 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:48.212028 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:48.222638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:48.233498 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:48.243969 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:48.362787 tst ping.py:19: start network... 09:14:48.556156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:49.007010 run create_hlr_db(pid=30510): Launched 09:14:49.117048 bus /gobi_6: Setting Powered False 09:14:50.175280 run create_hlr_db(pid=30510): Terminated: ok {rc=0} 09:14:50.578377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30512): Launched 09:14:50.866498 run osmo-hlr_10.42.42.2(pid=30513): Launched 09:14:50.976560 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:51.488233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30515): Launched 09:14:51.775736 run osmo-stp_10.42.42.5(pid=30516): Launched 09:14:51.886367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:52.383686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30518): Launched 09:14:52.494283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:52.737453 run patchelf(pid=30519): Launched 09:14:52.898448 run osmo-stp_10.42.42.5(pid=30516): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30516)] 09:14:53.021854 run osmo-stp_10.42.42.5(pid=30516): stdout: | (launched: 2022-12-13_09:14:51.723345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:53.146578 run osmo-stp_10.42.42.5(pid=30516): stderr: | 20221213091451891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091451891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091451891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091451892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091451892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091451892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091451892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:53.271477 run osmo-stp_10.42.42.5(pid=30516): stdout: | (launched: 2022-12-13_09:14:51.723345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:53.391163 run osmo-stp_10.42.42.5(pid=30516): stderr: | 20221213091451891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091451891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091451891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091451892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091451892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091451892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091451892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:53.532570 run patchelf(pid=30519): Terminating (SIGINT) 09:14:53.694764 run patchelf(pid=30519): Terminated: ok {rc=0} 09:14:53.811638 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30516): Process ended prematurely: osmo-stp_10.42.42.5(pid=30516) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30516)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 09:14:53.820412 tst ping.py:22: Test FAILED (6.2 sec) 09:14:53.846606 run osmo-hlr_10.42.42.2(pid=30513): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30513)] 09:14:53.894911 run osmo-hlr_10.42.42.2(pid=30513): stdout: | (launched: 2022-12-13_09:14:50.813779) 09:14:53.944072 run osmo-hlr_10.42.42.2(pid=30513): stderr: | 20221213091450987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091450987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091450987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091450987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091450987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091450987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091451002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091451012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091451012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091451012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:53.993750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30512): Terminating (SIGTERM) 09:14:54.033306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30515): Terminating (SIGTERM) 09:14:54.073015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30518): Terminating (SIGTERM) 09:14:54.112748 --- ParallelTerminationStrategy: PID 30512 died... 09:14:54.132052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30512): Terminated: ok {rc=0} 09:14:54.176213 --- ParallelTerminationStrategy: PID 30515 died... 09:14:54.194992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30515): Terminated: ok {rc=0} 09:14:54.238586 --- ParallelTerminationStrategy: PID 30518 died... 09:14:54.257445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30518): Terminated: ok {rc=0} 09:14:54.340101 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:14:55.426667 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:55.439208 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:14:55.513300 tst ping_idle_ping.py: using LAC 32955 09:14:55.634709 tst ping_idle_ping.py: using RAC 60 09:14:55.759720 tst ping_idle_ping.py: using CellId 32955 09:14:55.881636 tst ping_idle_ping.py: using BVCI 32956 09:14:55.993654 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:56.004895 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:56.016069 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:56.027144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:56.038355 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:56.049443 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:56.060493 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:56.071586 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:56.187657 tst ping_idle_ping.py:24: start network... 09:14:56.395895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:56.874129 run create_hlr_db(pid=30520): Launched 09:14:56.999573 bus /gobi_6: Setting Powered False 09:14:58.057370 run create_hlr_db(pid=30520): Terminated: ok {rc=0} 09:14:58.488113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30522): Launched 09:14:58.795867 run osmo-hlr_10.42.42.2(pid=30523): Launched 09:14:58.913175 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:59.443465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30525): Launched 09:14:59.751877 run osmo-stp_10.42.42.5(pid=30526): Launched 09:14:59.869490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:00.402777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30528): Launched 09:15:00.520659 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:00.781912 run patchelf(pid=30529): Launched 09:15:00.977051 run osmo-stp_10.42.42.5(pid=30526): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30526)] 09:15:01.113343 run osmo-stp_10.42.42.5(pid=30526): stdout: | (launched: 2022-12-13_09:14:59.695923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:01.253220 run osmo-stp_10.42.42.5(pid=30526): stderr: | 20221213091459885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091459886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091459886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091459886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091459887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091459887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091459887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:01.397746 run osmo-stp_10.42.42.5(pid=30526): stdout: | (launched: 2022-12-13_09:14:59.695923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:01.527538 run osmo-stp_10.42.42.5(pid=30526): stderr: | 20221213091459885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091459886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091459886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091459886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091459887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091459887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091459887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:01.681075 run patchelf(pid=30529): Terminating (SIGINT) 09:15:01.858431 run patchelf(pid=30529): Terminated: ok {rc=0} 09:15:01.986336 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30526): Process ended prematurely: osmo-stp_10.42.42.5(pid=30526) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30526)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:15:01.996389 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:15:02.024923 run osmo-hlr_10.42.42.2(pid=30523): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30523)] 09:15:02.075544 run osmo-hlr_10.42.42.2(pid=30523): stdout: | (launched: 2022-12-13_09:14:58.740266) 09:15:02.127759 run osmo-hlr_10.42.42.2(pid=30523): stderr: | 20221213091458938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091458938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091458938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091458938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091458938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091458938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091458950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091458958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091458959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091458959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:02.180206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30522): Terminating (SIGTERM) 09:15:02.222958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30525): Terminating (SIGTERM) 09:15:02.265447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30528): Terminating (SIGTERM) 09:15:02.307594 --- ParallelTerminationStrategy: PID 30522 died... 09:15:02.327742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30522): Terminated: ok {rc=0} 09:15:02.374740 --- ParallelTerminationStrategy: PID 30525 died... 09:15:02.394198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30525): Terminated: ok {rc=0} 09:15:02.439564 --- ParallelTerminationStrategy: PID 30528 died... 09:15:02.458965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30528): Terminated: ok {rc=0} 09:15:02.544177 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:15:03.852197 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:03.858746 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:15:03.891664 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:15:03.932429 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:15:04.025717 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:15:04.059622 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:15:04.099914 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:15:04.690676 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:15:04.742111 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:04.753618 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:15:04.824634 tst cs_paging_gprs_active.py: using LAC 32956 09:15:04.949108 tst cs_paging_gprs_active.py: using RAC 61 09:15:05.071394 tst cs_paging_gprs_active.py: using CellId 32956 09:15:05.193952 tst cs_paging_gprs_active.py: using BVCI 32957 09:15:05.310128 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.321514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.332516 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.343738 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.355283 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.366955 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.379109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.390859 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:05.402697 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:05.520124 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:05.638976 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:15:05.837305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:06.133849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30536): Launched 09:15:06.391924 run iperf3-srv_10.42.42.10(pid=30537): Launched 09:15:06.502851 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:15:06.700466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:06.996790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30538): Launched 09:15:07.253484 run iperf3-srv_10.42.42.10(pid=30539): Launched 09:15:07.364879 tst cs_paging_gprs_active.py:38: start network... 09:15:07.563018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:08.021035 run create_hlr_db(pid=30540): Launched 09:15:08.135674 bus /gobi_6: Setting Powered False 09:15:09.194914 run create_hlr_db(pid=30540): Terminated: ok {rc=0} 09:15:09.628009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30542): Launched 09:15:09.928886 run osmo-hlr_10.42.42.2(pid=30543): Launched 09:15:10.041658 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:10.561033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30545): Launched 09:15:10.854413 run osmo-stp_10.42.42.5(pid=30546): Launched 09:15:10.966853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:11.472424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30548): Launched 09:15:11.584866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:11.835238 run patchelf(pid=30549): Launched 09:15:11.999125 run osmo-stp_10.42.42.5(pid=30546): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30546)] 09:15:12.124334 run osmo-stp_10.42.42.5(pid=30546): stdout: | (launched: 2022-12-13_09:15:10.801138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:12.251083 run osmo-stp_10.42.42.5(pid=30546): stderr: | 20221213091510970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091510971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091510971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091510971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091510972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091510972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091510972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:12.378403 run osmo-stp_10.42.42.5(pid=30546): stdout: | (launched: 2022-12-13_09:15:10.801138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:12.499829 run osmo-stp_10.42.42.5(pid=30546): stderr: | 20221213091510970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091510971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091510971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091510971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091510972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091510972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091510972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:12.643279 run patchelf(pid=30549): Terminating (SIGINT) 09:15:12.809191 run patchelf(pid=30549): Terminated: ok {rc=0} 09:15:12.928792 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30546): Process ended prematurely: osmo-stp_10.42.42.5(pid=30546) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30546)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:15:12.938331 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 09:15:12.965059 run osmo-hlr_10.42.42.2(pid=30543): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30543)] 09:15:13.013068 run osmo-hlr_10.42.42.2(pid=30543): stdout: | (launched: 2022-12-13_09:15:09.874972) 09:15:13.062494 run osmo-hlr_10.42.42.2(pid=30543): stderr: | 20221213091510051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091510051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091510051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091510051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091510051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091510051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091510064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091510072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091510072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091510072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:13.112114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30536): Terminating (SIGTERM) 09:15:13.151637 run iperf3-srv_10.42.42.10(pid=30537): Terminating (SIGTERM) 09:15:13.191176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30538): Terminating (SIGTERM) 09:15:13.230775 run iperf3-srv_10.42.42.10(pid=30539): Terminating (SIGTERM) 09:15:13.270267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30542): Terminating (SIGTERM) 09:15:13.309792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30545): Terminating (SIGTERM) 09:15:13.349402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30548): Terminating (SIGTERM) 09:15:13.389470 --- ParallelTerminationStrategy: PID 30536 died... 09:15:13.408782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30536): Terminated: ok {rc=0} 09:15:13.452695 --- ParallelTerminationStrategy: PID 30537 died... 09:15:13.471660 run iperf3-srv_10.42.42.10(pid=30537): Terminated {rc=256} 09:15:13.515281 --- ParallelTerminationStrategy: PID 30538 died... 09:15:13.534164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30538): Terminated: ok {rc=0} 09:15:13.577686 --- ParallelTerminationStrategy: PID 30539 died... 09:15:13.596432 run iperf3-srv_10.42.42.10(pid=30539): Terminated {rc=256} 09:15:13.639836 --- ParallelTerminationStrategy: PID 30542 died... 09:15:13.658598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30542): Terminated: ok {rc=0} 09:15:13.702064 --- ParallelTerminationStrategy: PID 30545 died... 09:15:13.720842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30545): Terminated: ok {rc=0} 09:15:13.764289 --- ParallelTerminationStrategy: PID 30548 died... 09:15:13.783228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30548): Terminated: ok {rc=0} 09:15:13.869501 bus /gobi_0: Setting Powered False 09:15:14.967337 bus /gobi_0: Setting Powered False 09:15:16.077379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:15:17.236060 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.248089 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:15:17.319154 tst iperf3.py: using LAC 32957 09:15:17.445123 tst iperf3.py: using RAC 62 09:15:17.569906 tst iperf3.py: using CellId 32957 09:15:17.694997 tst iperf3.py: using BVCI 32958 09:15:17.809007 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.820519 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.831878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.843212 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.854450 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.865819 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.877270 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.888171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.899338 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:18.015908 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:15:18.212928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:18.507933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30550): Launched 09:15:18.762962 run iperf3-srv_10.42.42.10(pid=30551): Launched 09:15:18.872629 tst iperf3.py:8: start network... 09:15:19.068275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:19.520630 run create_hlr_db(pid=30552): Launched 09:15:19.633469 bus /gobi_6: Setting Powered False 09:15:20.691915 run create_hlr_db(pid=30552): Terminated: ok {rc=0} 09:15:21.118656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30554): Launched 09:15:21.431870 run osmo-hlr_10.42.42.2(pid=30555): Launched 09:15:21.551446 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:22.092675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30557): Launched 09:15:22.406331 run osmo-stp_10.42.42.5(pid=30558): Launched 09:15:22.526240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:23.067046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30560): Launched 09:15:23.187034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:23.452629 run patchelf(pid=30561): Launched 09:15:23.627230 run osmo-stp_10.42.42.5(pid=30558): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30558)] 09:15:23.759964 run osmo-stp_10.42.42.5(pid=30558): stdout: | (launched: 2022-12-13_09:15:22.348761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:23.894142 run osmo-stp_10.42.42.5(pid=30558): stderr: | 20221213091522540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091522540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091522540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091522541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091522541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091522541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091522541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:24.028429 run osmo-stp_10.42.42.5(pid=30558): stdout: | (launched: 2022-12-13_09:15:22.348761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:24.157310 run osmo-stp_10.42.42.5(pid=30558): stderr: | 20221213091522540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091522540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091522540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091522541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091522541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091522541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091522541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:24.309917 run patchelf(pid=30561): Terminating (SIGINT) 09:15:24.487523 run patchelf(pid=30561): Terminated: ok {rc=0} 09:15:24.614844 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30558): Process ended prematurely: osmo-stp_10.42.42.5(pid=30558) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30558)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 09:15:24.624779 tst iperf3.py:8: Test FAILED (7.4 sec) 09:15:24.653069 run osmo-hlr_10.42.42.2(pid=30555): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30555)] 09:15:24.703350 run osmo-hlr_10.42.42.2(pid=30555): stdout: | (launched: 2022-12-13_09:15:21.375022) 09:15:24.755267 run osmo-hlr_10.42.42.2(pid=30555): stderr: | 20221213091521571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091521571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091521571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091521571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091521571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091521571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091521583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091521591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091521591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091521591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:24.807343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30550): Terminating (SIGTERM) 09:15:24.848674 run iperf3-srv_10.42.42.10(pid=30551): Terminating (SIGTERM) 09:15:24.890092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30554): Terminating (SIGTERM) 09:15:24.931702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30557): Terminating (SIGTERM) 09:15:24.973221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30560): Terminating (SIGTERM) 09:15:25.015136 --- ParallelTerminationStrategy: PID 30550 died... 09:15:25.035336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30550): Terminated: ok {rc=0} 09:15:25.081396 --- ParallelTerminationStrategy: PID 30551 died... 09:15:25.101033 run iperf3-srv_10.42.42.10(pid=30551): Terminated {rc=256} 09:15:25.146758 --- ParallelTerminationStrategy: PID 30554 died... 09:15:25.166117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30554): Terminated: ok {rc=0} 09:15:25.211874 --- ParallelTerminationStrategy: PID 30557 died... 09:15:25.231181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30557): Terminated: ok {rc=0} 09:15:25.276867 --- ParallelTerminationStrategy: PID 30560 died... 09:15:25.296717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30560): Terminated: ok {rc=0} 09:15:25.385132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:15:26.531288 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:26.543331 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:15:26.616257 tst iperf3m4.py: using LAC 32958 09:15:26.740051 tst iperf3m4.py: using RAC 63 09:15:26.862952 tst iperf3m4.py: using CellId 32958 09:15:26.985389 tst iperf3m4.py: using BVCI 32959 09:15:27.099421 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.110823 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.122028 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.133275 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.144189 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.155444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.166699 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.177838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:27.189126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:27.305183 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:27.426037 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:27.541916 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:27.656585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:15:27.854182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:28.148272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30562): Launched 09:15:28.403672 run iperf3-srv_10.42.42.10(pid=30563): Launched 09:15:28.514437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:15:28.709972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:29.003602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30564): Launched 09:15:29.257622 run iperf3-srv_10.42.42.10(pid=30565): Launched 09:15:29.367642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:15:29.563197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:29.856827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30566): Launched 09:15:30.110788 run iperf3-srv_10.42.42.10(pid=30567): Launched 09:15:30.220830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:15:30.416827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:30.710420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30568): Launched 09:15:31.004103 run iperf3-srv_10.42.42.10(pid=30569): Launched 09:15:31.150666 tst iperf3m4.py:8: start network... 09:15:31.367835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:31.882083 run create_hlr_db(pid=30570): Launched 09:15:32.035677 bus /gobi_6: Setting Powered False 09:15:33.097827 run create_hlr_db(pid=30570): Terminated: ok {rc=0} 09:15:33.535925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30572): Launched 09:15:33.848637 run osmo-hlr_10.42.42.2(pid=30573): Launched 09:15:33.968098 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:34.518074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30575): Launched 09:15:34.830349 run osmo-stp_10.42.42.5(pid=30576): Launched 09:15:34.949350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:35.490043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30578): Launched 09:15:35.609327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:35.873448 run patchelf(pid=30579): Launched 09:15:36.047402 run osmo-stp_10.42.42.5(pid=30576): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30576)] 09:15:36.180128 run osmo-stp_10.42.42.5(pid=30576): stdout: | (launched: 2022-12-13_09:15:34.773574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:36.314661 run osmo-stp_10.42.42.5(pid=30576): stderr: | 20221213091534966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091534966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091534966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091534967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091534967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091534967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091534967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:36.449876 run osmo-stp_10.42.42.5(pid=30576): stdout: | (launched: 2022-12-13_09:15:34.773574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:36.579545 run osmo-stp_10.42.42.5(pid=30576): stderr: | 20221213091534966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091534966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091534966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091534967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091534967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091534967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091534967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:36.732393 run patchelf(pid=30579): Terminating (SIGINT) 09:15:36.908873 run patchelf(pid=30579): Terminated: ok {rc=0} 09:15:37.035965 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30576): Process ended prematurely: osmo-stp_10.42.42.5(pid=30576) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30576)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:15:37.046147 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:15:37.074360 run osmo-hlr_10.42.42.2(pid=30573): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30573)] 09:15:37.124222 run osmo-hlr_10.42.42.2(pid=30573): stdout: | (launched: 2022-12-13_09:15:33.791593) 09:15:37.175885 run osmo-hlr_10.42.42.2(pid=30573): stderr: | 20221213091533988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091533988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091533988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091533988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091533988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091533988 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091534001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091534009 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091534009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091534009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:37.227952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30562): Terminating (SIGTERM) 09:15:37.269606 run iperf3-srv_10.42.42.10(pid=30563): Terminating (SIGTERM) 09:15:37.311573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30564): Terminating (SIGTERM) 09:15:37.354395 run iperf3-srv_10.42.42.10(pid=30565): Terminating (SIGTERM) 09:15:37.395918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30566): Terminating (SIGTERM) 09:15:37.437896 run iperf3-srv_10.42.42.10(pid=30567): Terminating (SIGTERM) 09:15:37.479080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30568): Terminating (SIGTERM) 09:15:37.520935 run iperf3-srv_10.42.42.10(pid=30569): Terminating (SIGTERM) 09:15:37.562287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30572): Terminating (SIGTERM) 09:15:37.604112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30575): Terminating (SIGTERM) 09:15:37.645463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30578): Terminating (SIGTERM) 09:15:37.687050 --- ParallelTerminationStrategy: PID 30562 died... 09:15:37.706873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30562): Terminated: ok {rc=0} 09:15:37.753549 --- ParallelTerminationStrategy: PID 30563 died... 09:15:37.772873 run iperf3-srv_10.42.42.10(pid=30563): Terminated {rc=256} 09:15:37.818340 --- ParallelTerminationStrategy: PID 30564 died... 09:15:37.837681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30564): Terminated: ok {rc=0} 09:15:37.883447 --- ParallelTerminationStrategy: PID 30565 died... 09:15:37.902786 run iperf3-srv_10.42.42.10(pid=30565): Terminated {rc=256} 09:15:37.948367 --- ParallelTerminationStrategy: PID 30566 died... 09:15:37.967736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30566): Terminated: ok {rc=0} 09:15:38.013514 --- ParallelTerminationStrategy: PID 30567 died... 09:15:38.032833 run iperf3-srv_10.42.42.10(pid=30567): Terminated {rc=256} 09:15:38.078377 --- ParallelTerminationStrategy: PID 30568 died... 09:15:38.097701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30568): Terminated: ok {rc=0} 09:15:38.143457 --- ParallelTerminationStrategy: PID 30569 died... 09:15:38.162928 run iperf3-srv_10.42.42.10(pid=30569): Terminated {rc=256} 09:15:38.208520 --- ParallelTerminationStrategy: PID 30572 died... 09:15:38.227902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30572): Terminated: ok {rc=0} 09:15:38.273384 --- ParallelTerminationStrategy: PID 30575 died... 09:15:38.292501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30575): Terminated: ok {rc=0} 09:15:38.338304 --- ParallelTerminationStrategy: PID 30578 died... 09:15:38.357657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30578): Terminated: ok {rc=0} 09:15:38.444854 bus /gobi_4: Setting Powered False 09:15:39.542771 bus /gobi_4: Setting Powered False 09:15:40.656505 bus /gobi_1: Setting Powered False 09:15:41.753754 bus /gobi_1: Setting Powered False 09:15:42.869907 bus /gobi_0: Setting Powered False 09:15:43.966794 bus /gobi_0: Setting Powered False 09:15:45.083723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:15:46.198100 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.215346 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:15:46.301199 tst ping.py: using LAC 32959 09:15:46.433272 tst ping.py: using RAC 64 09:15:46.556504 tst ping.py: using CellId 32959 09:15:46.673643 tst ping.py: using BVCI 32960 09:15:46.789064 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.801664 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.813864 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.826086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.838226 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.849950 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.862862 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:46.874922 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:46.991325 tst ping.py:19: start network... 09:15:47.201871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:47.684784 run create_hlr_db(pid=30581): Launched 09:15:47.810715 bus /gobi_6: Setting Powered False 09:15:48.872434 run create_hlr_db(pid=30581): Terminated: ok {rc=0} 09:15:49.301982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30583): Launched 09:15:49.609929 run osmo-hlr_10.42.42.2(pid=30584): Launched 09:15:49.726660 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:50.233152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30586): Launched 09:15:50.521087 run osmo-stp_10.42.42.5(pid=30587): Launched 09:15:50.632321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:51.128828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30589): Launched 09:15:51.239269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:51.483085 run patchelf(pid=30590): Launched 09:15:51.643867 run osmo-stp_10.42.42.5(pid=30587): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30587)] 09:15:51.767576 run osmo-stp_10.42.42.5(pid=30587): stdout: | (launched: 2022-12-13_09:15:50.468412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:51.906369 run osmo-stp_10.42.42.5(pid=30587): stderr: | 20221213091550635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091550635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091550636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091550636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091550638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091550638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091550638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:52.031937 run osmo-stp_10.42.42.5(pid=30587): stdout: | (launched: 2022-12-13_09:15:50.468412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:52.151347 run osmo-stp_10.42.42.5(pid=30587): stderr: | 20221213091550635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091550635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091550636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091550636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091550638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091550638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091550638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:52.292579 run patchelf(pid=30590): Terminating (SIGINT) 09:15:52.456208 run patchelf(pid=30590): Terminated: ok {rc=0} 09:15:52.573869 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30587): Process ended prematurely: osmo-stp_10.42.42.5(pid=30587) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30587)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 09:15:52.582950 tst ping.py:22: Test FAILED (6.4 sec) 09:15:52.609543 run osmo-hlr_10.42.42.2(pid=30584): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30584)] 09:15:52.657740 run osmo-hlr_10.42.42.2(pid=30584): stdout: | (launched: 2022-12-13_09:15:49.554052) 09:15:52.707073 run osmo-hlr_10.42.42.2(pid=30584): stderr: | 20221213091549739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091549739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091549739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091549739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091549739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091549739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091549753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091549762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091549762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091549762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:52.756756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30583): Terminating (SIGTERM) 09:15:52.796332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30586): Terminating (SIGTERM) 09:15:52.836277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30589): Terminating (SIGTERM) 09:15:52.875999 --- ParallelTerminationStrategy: PID 30583 died... 09:15:52.895272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30583): Terminated: ok {rc=0} 09:15:52.939190 --- ParallelTerminationStrategy: PID 30586 died... 09:15:52.957866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30586): Terminated: ok {rc=0} 09:15:53.001410 --- ParallelTerminationStrategy: PID 30589 died... 09:15:53.020140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30589): Terminated: ok {rc=0} 09:15:53.103679 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:15:54.189883 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.202349 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:15:54.276451 tst ping_idle_ping.py: using LAC 32960 09:15:54.400001 tst ping_idle_ping.py: using RAC 65 09:15:54.525607 tst ping_idle_ping.py: using CellId 32960 09:15:54.640698 tst ping_idle_ping.py: using BVCI 32961 09:15:54.747057 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.758132 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.768942 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.779827 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.791455 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.803113 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.814931 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:54.826701 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:54.945944 tst ping_idle_ping.py:24: start network... 09:15:55.154277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:55.635852 run create_hlr_db(pid=30593): Launched 09:15:55.762054 bus /gobi_6: Setting Powered False 09:15:56.824148 run create_hlr_db(pid=30593): Terminated: ok {rc=0} 09:15:57.238414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30595): Launched 09:15:57.528350 run osmo-hlr_10.42.42.2(pid=30596): Launched 09:15:57.639481 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:58.152527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30598): Launched 09:15:58.443094 run osmo-stp_10.42.42.5(pid=30599): Launched 09:15:58.554005 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:59.055251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30601): Launched 09:15:59.165891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:59.410525 run patchelf(pid=30602): Launched 09:15:59.571940 run osmo-stp_10.42.42.5(pid=30599): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30599)] 09:15:59.695412 run osmo-stp_10.42.42.5(pid=30599): stdout: | (launched: 2022-12-13_09:15:58.390346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:59.820324 run osmo-stp_10.42.42.5(pid=30599): stderr: | 20221213091558559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091558559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091558559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091558560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091558560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091558560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091558560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:59.945489 run osmo-stp_10.42.42.5(pid=30599): stdout: | (launched: 2022-12-13_09:15:58.390346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:00.065246 run osmo-stp_10.42.42.5(pid=30599): stderr: | 20221213091558559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091558559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091558559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091558560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091558560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091558560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091558560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:00.208186 run patchelf(pid=30602): Terminating (SIGINT) 09:16:00.371776 run patchelf(pid=30602): Terminated: ok {rc=0} 09:16:00.489847 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30599): Process ended prematurely: osmo-stp_10.42.42.5(pid=30599) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30599)] [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:16:00.498645 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:16:00.524912 run osmo-hlr_10.42.42.2(pid=30596): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30596)] 09:16:00.572640 run osmo-hlr_10.42.42.2(pid=30596): stdout: | (launched: 2022-12-13_09:15:57.475047) 09:16:00.621615 run osmo-hlr_10.42.42.2(pid=30596): stderr: | 20221213091557649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091557649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091557649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091557650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091557650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091557650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091557663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091557671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091557671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091557671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:00.670959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30595): Terminating (SIGTERM) 09:16:00.710808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30598): Terminating (SIGTERM) 09:16:00.750183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30601): Terminating (SIGTERM) 09:16:00.789702 --- ParallelTerminationStrategy: PID 30595 died... 09:16:00.809100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30595): Terminated: ok {rc=0} 09:16:00.856821 --- ParallelTerminationStrategy: PID 30598 died... 09:16:00.877276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30598): Terminated: ok {rc=0} 09:16:00.943921 --- ParallelTerminationStrategy: PID 30601 died... 09:16:00.963961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30601): Terminated: ok {rc=0} 09:16:01.054621 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:16:02.379394 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:02.386050 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:16:02.418265 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:16:02.457441 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:16:02.550155 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:16:02.583629 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:16:02.623722 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:16:03.228588 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:16:03.280541 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.292344 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:16:03.346179 tst cs_paging_gprs_active.py: using LAC 32961 09:16:03.471900 tst cs_paging_gprs_active.py: using RAC 66 09:16:03.595686 tst cs_paging_gprs_active.py: using CellId 32961 09:16:03.720086 tst cs_paging_gprs_active.py: using BVCI 32962 09:16:03.835216 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.846821 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.858277 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.869725 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.881751 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.893745 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.905874 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.917935 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:03.930192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:04.046821 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:04.160130 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:16:04.358066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:04.653752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30606): Launched 09:16:04.910885 run iperf3-srv_10.42.42.10(pid=30607): Launched 09:16:05.021877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:16:05.219634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:05.515205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30608): Launched 09:16:05.771180 run iperf3-srv_10.42.42.10(pid=30609): Launched 09:16:05.882056 tst cs_paging_gprs_active.py:38: start network... 09:16:06.079688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:06.536797 run create_hlr_db(pid=30610): Launched 09:16:06.650127 bus /gobi_6: Setting Powered False 09:16:07.709329 run create_hlr_db(pid=30610): Terminated: ok {rc=0} 09:16:08.141848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30612): Launched 09:16:08.458565 run osmo-hlr_10.42.42.2(pid=30613): Launched 09:16:08.580308 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:09.124501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30615): Launched 09:16:09.439588 run osmo-stp_10.42.42.5(pid=30616): Launched 09:16:09.560866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:10.103800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30618): Launched 09:16:10.223400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:10.490473 run patchelf(pid=30619): Launched 09:16:10.665444 run osmo-stp_10.42.42.5(pid=30616): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30616)] 09:16:10.799582 run osmo-stp_10.42.42.5(pid=30616): stdout: | (launched: 2022-12-13_09:16:09.382262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:10.935274 run osmo-stp_10.42.42.5(pid=30616): stderr: | 20221213091609571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091609571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091609572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091609572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091609574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091609574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091609574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:11.070658 run osmo-stp_10.42.42.5(pid=30616): stdout: | (launched: 2022-12-13_09:16:09.382262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:11.200390 run osmo-stp_10.42.42.5(pid=30616): stderr: | 20221213091609571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091609571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091609572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091609572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091609574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091609574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091609574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:11.354194 run patchelf(pid=30619): Terminating (SIGINT) 09:16:11.531784 run patchelf(pid=30619): Terminated: ok {rc=0} 09:16:11.659172 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30616): Process ended prematurely: osmo-stp_10.42.42.5(pid=30616) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30616)] [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:16:11.669259 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:16:11.697445 run osmo-hlr_10.42.42.2(pid=30613): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30613)] 09:16:11.747466 run osmo-hlr_10.42.42.2(pid=30613): stdout: | (launched: 2022-12-13_09:16:08.400194) 09:16:11.798793 run osmo-hlr_10.42.42.2(pid=30613): stderr: | 20221213091608600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091608600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091608600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091608600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091608600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091608600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091608617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091608626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091608626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091608626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:11.850832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30606): Terminating (SIGTERM) 09:16:11.892251 run iperf3-srv_10.42.42.10(pid=30607): Terminating (SIGTERM) 09:16:11.934273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30608): Terminating (SIGTERM) 09:16:11.975778 run iperf3-srv_10.42.42.10(pid=30609): Terminating (SIGTERM) 09:16:12.017839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30612): Terminating (SIGTERM) 09:16:12.059379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30615): Terminating (SIGTERM) 09:16:12.101464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30618): Terminating (SIGTERM) 09:16:12.143644 --- ParallelTerminationStrategy: PID 30606 died... 09:16:12.163552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30606): Terminated: ok {rc=0} 09:16:12.209735 --- ParallelTerminationStrategy: PID 30607 died... 09:16:12.229054 run iperf3-srv_10.42.42.10(pid=30607): Terminated {rc=256} 09:16:12.274780 --- ParallelTerminationStrategy: PID 30608 died... 09:16:12.294245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30608): Terminated: ok {rc=0} 09:16:12.340098 --- ParallelTerminationStrategy: PID 30609 died... 09:16:12.359427 run iperf3-srv_10.42.42.10(pid=30609): Terminated {rc=256} 09:16:12.405447 --- ParallelTerminationStrategy: PID 30612 died... 09:16:12.424591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30612): Terminated: ok {rc=0} 09:16:12.470691 --- ParallelTerminationStrategy: PID 30615 died... 09:16:12.490099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30615): Terminated: ok {rc=0} 09:16:12.535874 --- ParallelTerminationStrategy: PID 30618 died... 09:16:12.555278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30618): Terminated: ok {rc=0} 09:16:12.642006 bus /gobi_0: Setting Powered False 09:16:13.739623 bus /gobi_0: Setting Powered False 09:16:14.850773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:16:16.001096 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.015389 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:16:16.073414 tst iperf3.py: using LAC 32962 09:16:16.192082 tst iperf3.py: using RAC 67 09:16:16.318560 tst iperf3.py: using CellId 32962 09:16:16.439187 tst iperf3.py: using BVCI 32963 09:16:16.564087 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.576011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.587926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.599461 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.611551 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.623641 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.635738 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.647619 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:16.659786 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:16.783047 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:16:17.008077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:17.316435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30620): Launched 09:16:17.573515 run iperf3-srv_10.42.42.10(pid=30621): Launched 09:16:17.688028 tst iperf3.py:8: start network... 09:16:17.886626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:18.374983 run create_hlr_db(pid=30622): Launched 09:16:18.503922 bus /gobi_6: Setting Powered False 09:16:19.566504 run create_hlr_db(pid=30622): Terminated: ok {rc=0} 09:16:19.986528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30624): Launched 09:16:20.280204 run osmo-hlr_10.42.42.2(pid=30625): Launched 09:16:20.393415 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:20.916117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30627): Launched 09:16:21.210205 run osmo-stp_10.42.42.5(pid=30628): Launched 09:16:21.322246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:21.843160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30630): Launched 09:16:21.956422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:22.205328 run patchelf(pid=30631): Launched 09:16:22.368769 run osmo-stp_10.42.42.5(pid=30628): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30628)] 09:16:22.494241 run osmo-stp_10.42.42.5(pid=30628): stdout: | (launched: 2022-12-13_09:16:21.156404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:22.621320 run osmo-stp_10.42.42.5(pid=30628): stderr: | 20221213091621325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091621325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091621325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091621325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091621326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091621326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091621326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:22.747930 run osmo-stp_10.42.42.5(pid=30628): stdout: | (launched: 2022-12-13_09:16:21.156404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:22.869640 run osmo-stp_10.42.42.5(pid=30628): stderr: | 20221213091621325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091621325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091621325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091621325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091621326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091621326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091621326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:23.013682 run patchelf(pid=30631): Terminating (SIGINT) 09:16:23.180088 run patchelf(pid=30631): Terminated: ok {rc=0} 09:16:23.300629 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30628): Process ended prematurely: osmo-stp_10.42.42.5(pid=30628) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30628)] [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:16:23.310308 tst iperf3.py:8: Test FAILED (7.3 sec) 09:16:23.337415 run osmo-hlr_10.42.42.2(pid=30625): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30625)] 09:16:23.385135 run osmo-hlr_10.42.42.2(pid=30625): stdout: | (launched: 2022-12-13_09:16:20.226840) 09:16:23.434353 run osmo-hlr_10.42.42.2(pid=30625): stderr: | 20221213091620402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091620402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091620402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091620402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091620402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091620402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091620414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091620424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091620425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091620425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:23.484097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30620): Terminating (SIGTERM) 09:16:23.523885 run iperf3-srv_10.42.42.10(pid=30621): Terminating (SIGTERM) 09:16:23.563361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30624): Terminating (SIGTERM) 09:16:23.603163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30627): Terminating (SIGTERM) 09:16:23.642892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30630): Terminating (SIGTERM) 09:16:23.682646 --- ParallelTerminationStrategy: PID 30620 died... 09:16:23.702125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30620): Terminated: ok {rc=0} 09:16:23.746040 --- ParallelTerminationStrategy: PID 30621 died... 09:16:23.764777 run iperf3-srv_10.42.42.10(pid=30621): Terminated {rc=256} 09:16:23.808523 --- ParallelTerminationStrategy: PID 30624 died... 09:16:23.827372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30624): Terminated: ok {rc=0} 09:16:23.871089 --- ParallelTerminationStrategy: PID 30627 died... 09:16:23.889694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30627): Terminated: ok {rc=0} 09:16:23.933245 --- ParallelTerminationStrategy: PID 30630 died... 09:16:23.951909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30630): Terminated: ok {rc=0} 09:16:24.035306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:16:25.182427 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.194566 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:16:25.248230 tst iperf3m4.py: using LAC 32963 09:16:25.366791 tst iperf3m4.py: using RAC 68 09:16:25.484751 tst iperf3m4.py: using CellId 32963 09:16:25.603197 tst iperf3m4.py: using BVCI 32964 09:16:25.710193 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.721569 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.732697 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.743803 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.755099 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.766391 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.777853 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.789091 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:25.800462 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:25.920652 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:26.038572 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:26.158782 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:26.276787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:16:26.491522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:26.807501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30632): Launched 09:16:27.081211 run iperf3-srv_10.42.42.10(pid=30633): Launched 09:16:27.199692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:16:27.411791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:27.726985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30634): Launched 09:16:28.000102 run iperf3-srv_10.42.42.10(pid=30635): Launched 09:16:28.117662 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:16:28.329354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:28.645061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30636): Launched 09:16:28.917225 run iperf3-srv_10.42.42.10(pid=30637): Launched 09:16:29.035051 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:16:29.247126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:29.563413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30638): Launched 09:16:29.836164 run iperf3-srv_10.42.42.10(pid=30639): Launched 09:16:29.954189 tst iperf3m4.py:8: start network... 09:16:30.166236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:30.654455 run create_hlr_db(pid=30640): Launched 09:16:30.783922 bus /gobi_6: Setting Powered False 09:16:31.856277 run create_hlr_db(pid=30640): Terminated: ok {rc=0} 09:16:32.318654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30642): Launched 09:16:32.613423 run osmo-hlr_10.42.42.2(pid=30643): Launched 09:16:32.726193 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:33.245306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30645): Launched 09:16:33.538344 run osmo-stp_10.42.42.5(pid=30646): Launched 09:16:33.649697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:34.156345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30648): Launched 09:16:34.268897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:34.517384 run patchelf(pid=30649): Launched 09:16:34.680580 run osmo-stp_10.42.42.5(pid=30646): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30646)] 09:16:34.805365 run osmo-stp_10.42.42.5(pid=30646): stdout: | (launched: 2022-12-13_09:16:33.484837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:34.931587 run osmo-stp_10.42.42.5(pid=30646): stderr: | 20221213091633653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091633653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091633654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091633654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091633654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091633654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091633655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:35.058197 run osmo-stp_10.42.42.5(pid=30646): stdout: | (launched: 2022-12-13_09:16:33.484837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:35.179233 run osmo-stp_10.42.42.5(pid=30646): stderr: | 20221213091633653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091633653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091633654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091633654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091633654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091633654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091633655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:35.322341 run patchelf(pid=30649): Terminating (SIGINT) 09:16:35.487934 run patchelf(pid=30649): Terminated: ok {rc=0} 09:16:35.607755 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30646): Process ended prematurely: osmo-stp_10.42.42.5(pid=30646) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30646)] [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:16:35.617257 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:16:35.644298 run osmo-hlr_10.42.42.2(pid=30643): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30643)] 09:16:35.692099 run osmo-hlr_10.42.42.2(pid=30643): stdout: | (launched: 2022-12-13_09:16:32.559668) 09:16:35.741298 run osmo-hlr_10.42.42.2(pid=30643): stderr: | 20221213091632738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091632738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091632738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091632738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091632738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091632738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091632752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091632762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091632762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091632762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:35.790692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30632): Terminating (SIGTERM) 09:16:35.830417 run iperf3-srv_10.42.42.10(pid=30633): Terminating (SIGTERM) 09:16:35.869751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30634): Terminating (SIGTERM) 09:16:35.909671 run iperf3-srv_10.42.42.10(pid=30635): Terminating (SIGTERM) 09:16:35.949472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30636): Terminating (SIGTERM) 09:16:35.989060 run iperf3-srv_10.42.42.10(pid=30637): Terminating (SIGTERM) 09:16:36.028465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30638): Terminating (SIGTERM) 09:16:36.068018 run iperf3-srv_10.42.42.10(pid=30639): Terminating (SIGTERM) 09:16:36.107434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30642): Terminating (SIGTERM) 09:16:36.146907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30645): Terminating (SIGTERM) 09:16:36.186313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30648): Terminating (SIGTERM) 09:16:36.225951 --- ParallelTerminationStrategy: PID 30632 died... 09:16:36.245514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30632): Terminated: ok {rc=0} 09:16:36.289315 --- ParallelTerminationStrategy: PID 30633 died... 09:16:36.307918 run iperf3-srv_10.42.42.10(pid=30633): Terminated {rc=256} 09:16:36.351602 --- ParallelTerminationStrategy: PID 30634 died... 09:16:36.370476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30634): Terminated: ok {rc=0} 09:16:36.413972 --- ParallelTerminationStrategy: PID 30635 died... 09:16:36.432728 run iperf3-srv_10.42.42.10(pid=30635): Terminated {rc=256} 09:16:36.476291 --- ParallelTerminationStrategy: PID 30636 died... 09:16:36.495081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30636): Terminated: ok {rc=0} 09:16:36.538368 --- ParallelTerminationStrategy: PID 30637 died... 09:16:36.557383 run iperf3-srv_10.42.42.10(pid=30637): Terminated {rc=256} 09:16:36.600594 --- ParallelTerminationStrategy: PID 30638 died... 09:16:36.619291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30638): Terminated: ok {rc=0} 09:16:36.662562 --- ParallelTerminationStrategy: PID 30639 died... 09:16:36.681479 run iperf3-srv_10.42.42.10(pid=30639): Terminated {rc=256} 09:16:36.724658 --- ParallelTerminationStrategy: PID 30642 died... 09:16:36.743293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30642): Terminated: ok {rc=0} 09:16:36.786566 --- ParallelTerminationStrategy: PID 30645 died... 09:16:36.805138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30645): Terminated: ok {rc=0} 09:16:36.848543 --- ParallelTerminationStrategy: PID 30648 died... 09:16:36.867226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30648): Terminated: ok {rc=0} 09:16:36.952102 bus /gobi_4: Setting Powered False 09:16:38.049968 bus /gobi_4: Setting Powered False 09:16:39.161945 bus /gobi_1: Setting Powered False 09:16:40.258232 bus /gobi_1: Setting Powered False 09:16:41.374076 bus /gobi_0: Setting Powered False 09:16:42.474042 bus /gobi_0: Setting Powered False 09:16:43.589103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:16:44.690135 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:44.702296 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:16:44.762275 tst ping.py: using LAC 32964 09:16:44.882713 tst ping.py: using RAC 69 09:16:45.003141 tst ping.py: using CellId 32964 09:16:45.126855 tst ping.py: using BVCI 32965 09:16:45.239913 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:45.251698 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:45.263216 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:45.274779 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:45.286296 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:45.297869 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:45.309458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:45.320934 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:45.436641 tst ping.py:19: start network... 09:16:45.630009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:46.103470 run create_hlr_db(pid=30650): Launched 09:16:46.239040 bus /gobi_6: Setting Powered False 09:16:47.306433 run create_hlr_db(pid=30650): Terminated: ok {rc=0} 09:16:47.709875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Launched 09:16:47.997376 run osmo-hlr_10.42.42.2(pid=30653): Launched 09:16:48.107486 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:48.606784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Launched 09:16:48.895551 run osmo-stp_10.42.42.5(pid=30656): Launched 09:16:49.005246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:49.505196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Launched 09:16:49.615707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:49.859381 run patchelf(pid=30659): Launched 09:16:50.019879 run osmo-stp_10.42.42.5(pid=30656): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] 09:16:50.142932 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-13_09:16:48.842663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:50.267586 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221213091649010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091649010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091649011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091649011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091649012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091649012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091649012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:50.392138 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-13_09:16:48.842663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:50.511225 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221213091649010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091649010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091649011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091649011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091649012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091649012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091649012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:50.652267 run patchelf(pid=30659): Terminating (SIGINT) 09:16:50.814743 run patchelf(pid=30659): Terminated: ok {rc=0} 09:16:50.932179 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:16:50.941033 tst ping.py:22: Test FAILED (6.2 sec) 09:16:50.967269 run osmo-hlr_10.42.42.2(pid=30653): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30653)] 09:16:51.014729 run osmo-hlr_10.42.42.2(pid=30653): stdout: | (launched: 2022-12-13_09:16:47.944405) 09:16:51.063863 run osmo-hlr_10.42.42.2(pid=30653): stderr: | 20221213091648119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091648119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091648119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091648119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091648120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091648120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091648133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091648141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091648141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091648141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:51.113643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminating (SIGTERM) 09:16:51.153054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminating (SIGTERM) 09:16:51.192576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Terminating (SIGTERM) 09:16:51.232156 --- ParallelTerminationStrategy: PID 30652 died... 09:16:51.251351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminated: ok {rc=0} 09:16:51.294818 --- ParallelTerminationStrategy: PID 30655 died... 09:16:51.313381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminated: ok {rc=0} 09:16:51.356768 --- ParallelTerminationStrategy: PID 30658 died... 09:16:51.375487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Terminated: ok {rc=0} 09:16:51.460246 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:16:52.546417 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:52.558625 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:16:52.617372 tst ping_idle_ping.py: using LAC 32965 09:16:52.732677 tst ping_idle_ping.py: using RAC 70 09:16:52.845769 tst ping_idle_ping.py: using CellId 32965 09:16:52.959609 tst ping_idle_ping.py: using BVCI 32966 09:16:53.064707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:53.076149 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:53.087144 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:53.098539 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:53.110453 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:53.122573 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:53.134540 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:16:53.146496 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:16:53.266715 tst ping_idle_ping.py:24: start network... 09:16:53.478209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:53.960794 run create_hlr_db(pid=30660): Launched 09:16:54.087707 bus /gobi_6: Setting Powered False 09:16:55.149794 run create_hlr_db(pid=30660): Terminated: ok {rc=0} 09:16:55.565596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30662): Launched 09:16:55.876505 run osmo-hlr_10.42.42.2(pid=30663): Launched 09:16:55.994485 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:56.529687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30665): Launched 09:16:56.838446 run osmo-stp_10.42.42.5(pid=30666): Launched 09:16:56.955274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:57.488805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30668): Launched 09:16:57.607143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:57.868500 run patchelf(pid=30669): Launched 09:16:58.039774 run osmo-stp_10.42.42.5(pid=30666): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30666)] 09:16:58.171032 run osmo-stp_10.42.42.5(pid=30666): stdout: | (launched: 2022-12-13_09:16:56.782441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:58.303592 run osmo-stp_10.42.42.5(pid=30666): stderr: | 20221213091656971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091656972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091656972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091656972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091656973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091656973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091656973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:58.436647 run osmo-stp_10.42.42.5(pid=30666): stdout: | (launched: 2022-12-13_09:16:56.782441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:58.564733 run osmo-stp_10.42.42.5(pid=30666): stderr: | 20221213091656971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091656972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091656972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091656972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091656973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091656973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091656973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:58.715391 run patchelf(pid=30669): Terminating (SIGINT) 09:16:58.888167 run patchelf(pid=30669): Terminated: ok {rc=0} 09:16:59.013011 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30666): Process ended prematurely: osmo-stp_10.42.42.5(pid=30666) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30666)] [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:16:59.022546 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:16:59.050123 run osmo-hlr_10.42.42.2(pid=30663): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30663)] 09:16:59.099726 run osmo-hlr_10.42.42.2(pid=30663): stdout: | (launched: 2022-12-13_09:16:55.820398) 09:16:59.150739 run osmo-hlr_10.42.42.2(pid=30663): stderr: | 20221213091656017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091656017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091656017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091656018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091656018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091656018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091656030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091656038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091656038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091656039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:59.202401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30662): Terminating (SIGTERM) 09:16:59.243726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30665): Terminating (SIGTERM) 09:16:59.285680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30668): Terminating (SIGTERM) 09:16:59.327635 --- ParallelTerminationStrategy: PID 30662 died... 09:16:59.347272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30662): Terminated: ok {rc=0} 09:16:59.393241 --- ParallelTerminationStrategy: PID 30665 died... 09:16:59.412553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30665): Terminated: ok {rc=0} 09:16:59.458052 --- ParallelTerminationStrategy: PID 30668 died... 09:16:59.477379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30668): Terminated: ok {rc=0} 09:16:59.564568 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:17:00.876398 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:00.888235 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:17:00.935994 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:17:00.972429 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:17:01.028398 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:17:01.066863 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:17:01.104272 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:17:01.663983 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:17:01.670221 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:01.682405 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:17:01.757885 tst switch_tch_pdch.py: using LAC 32966 09:17:01.910303 tst switch_tch_pdch.py: using RAC 71 09:17:02.057558 tst switch_tch_pdch.py: using CellId 32966 09:17:02.179535 tst switch_tch_pdch.py: using BVCI 32967 09:17:02.295733 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:02.308071 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:02.320251 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:02.332441 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:02.345196 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:02.356897 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:02.368808 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:02.380219 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:17:02.499244 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:17:02.617163 tst switch_tch_pdch.py:51: start network... 09:17:02.825490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:03.305682 run create_hlr_db(pid=30676): Launched 09:17:03.432790 bus /gobi_6: Setting Powered False 09:17:04.493763 run create_hlr_db(pid=30676): Terminated: ok {rc=0} 09:17:04.907516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30678): Launched 09:17:05.196572 run osmo-hlr_10.42.42.2(pid=30679): Launched 09:17:05.306842 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:05.823917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30681): Launched 09:17:06.111930 run osmo-stp_10.42.42.5(pid=30682): Launched 09:17:06.222088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:06.720579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30684): Launched 09:17:06.831511 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:07.075148 run patchelf(pid=30685): Launched 09:17:07.235937 run osmo-stp_10.42.42.5(pid=30682): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30682)] 09:17:07.358312 run osmo-stp_10.42.42.5(pid=30682): stdout: | (launched: 2022-12-13_09:17:06.059077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:07.482569 run osmo-stp_10.42.42.5(pid=30682): stderr: | 20221213091706226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091706226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091706227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091706227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091706227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091706228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091706228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:07.606939 run osmo-stp_10.42.42.5(pid=30682): stdout: | (launched: 2022-12-13_09:17:06.059077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:07.726525 run osmo-stp_10.42.42.5(pid=30682): stderr: | 20221213091706226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091706226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091706227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091706227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091706227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091706228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091706228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:07.867409 run patchelf(pid=30685): Terminating (SIGINT) 09:17:08.029751 run patchelf(pid=30685): Terminated: ok {rc=0} 09:17:08.146945 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30682): Process ended prematurely: osmo-stp_10.42.42.5(pid=30682) [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30682)] [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:17:08.156201 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 09:17:08.182482 run osmo-hlr_10.42.42.2(pid=30679): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30679)] 09:17:08.230207 run osmo-hlr_10.42.42.2(pid=30679): stdout: | (launched: 2022-12-13_09:17:05.143805) 09:17:08.279194 run osmo-hlr_10.42.42.2(pid=30679): stderr: | 20221213091705318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091705318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091705318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091705318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091705318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091705318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091705331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091705342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091705342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091705342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:08.328900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30678): Terminating (SIGTERM) 09:17:08.368780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30681): Terminating (SIGTERM) 09:17:08.408536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30684): Terminating (SIGTERM) 09:17:08.448558 --- ParallelTerminationStrategy: PID 30678 died... 09:17:08.467883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30678): Terminated: ok {rc=0} 09:17:08.511910 --- ParallelTerminationStrategy: PID 30681 died... 09:17:08.530540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30681): Terminated: ok {rc=0} 09:17:08.574554 --- ParallelTerminationStrategy: PID 30684 died... 09:17:08.593366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30684): Terminated: ok {rc=0} 09:17:08.679174 bus /gobi_0: Setting Powered False 09:17:09.777167 bus /gobi_0: Setting Powered False 09:17:10.890537 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:17:12.140615 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:12.146357 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:17:12.178055 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:17:12.217246 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:17:12.273894 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:17:12.307296 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:17:12.342662 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:17:12.892410 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:17:12.898450 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:12.909868 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:17:12.978292 tst switch_tch_pdch.py: using LAC 32967 09:17:13.093137 tst switch_tch_pdch.py: using RAC 72 09:17:13.215894 tst switch_tch_pdch.py: using CellId 32967 09:17:13.338022 tst switch_tch_pdch.py: using BVCI 32968 09:17:13.450548 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:13.461917 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:13.473007 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:13.484120 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:13.495757 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:13.507459 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:13.519392 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:13.531027 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:17:13.647523 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:17:13.760203 tst switch_tch_pdch.py:51: start network... 09:17:13.953341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:14.375044 run create_hlr_db(pid=30691): Launched 09:17:14.485616 bus /gobi_6: Setting Powered False 09:17:15.543848 run create_hlr_db(pid=30691): Terminated: ok {rc=0} 09:17:15.945620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30693): Launched 09:17:16.272215 run osmo-hlr_10.42.42.2(pid=30694): Launched 09:17:16.498997 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:17.164767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30696): Launched 09:17:17.468283 run osmo-stp_10.42.42.5(pid=30697): Launched 09:17:17.578259 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:18.051397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30699): Launched 09:17:18.162519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:18.406386 run patchelf(pid=30700): Launched 09:17:18.566341 run osmo-stp_10.42.42.5(pid=30697): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30697)] 09:17:18.689120 run osmo-stp_10.42.42.5(pid=30697): stdout: | (launched: 2022-12-13_09:17:17.415267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:18.812820 run osmo-stp_10.42.42.5(pid=30697): stderr: | 20221213091717586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091717586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091717586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091717586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091717587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091717587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091717587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:18.936916 run osmo-stp_10.42.42.5(pid=30697): stdout: | (launched: 2022-12-13_09:17:17.415267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:19.055681 run osmo-stp_10.42.42.5(pid=30697): stderr: | 20221213091717586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091717586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091717586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091717586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091717587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091717587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091717587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:19.196454 run patchelf(pid=30700): Terminating (SIGINT) 09:17:19.358608 run patchelf(pid=30700): Terminated: ok {rc=0} 09:17:19.475583 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30697): Process ended prematurely: osmo-stp_10.42.42.5(pid=30697) [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30697)] [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:17:19.484406 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:17:19.510322 run osmo-hlr_10.42.42.2(pid=30694): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30694)] 09:17:19.557869 run osmo-hlr_10.42.42.2(pid=30694): stdout: | (launched: 2022-12-13_09:17:16.209304) 09:17:19.606791 run osmo-hlr_10.42.42.2(pid=30694): stderr: | 20221213091716559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091716559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091716559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091716559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091716559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091716559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091716575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091716589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091716589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091716589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:19.656103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30693): Terminating (SIGTERM) 09:17:19.695458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30696): Terminating (SIGTERM) 09:17:19.734841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30699): Terminating (SIGTERM) 09:17:19.774457 --- ParallelTerminationStrategy: PID 30693 died... 09:17:19.793620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30693): Terminated: ok {rc=0} 09:17:19.837313 --- ParallelTerminationStrategy: PID 30696 died... 09:17:19.855840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30696): Terminated: ok {rc=0} 09:17:19.899202 --- ParallelTerminationStrategy: PID 30699 died... 09:17:19.917821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30699): Terminated: ok {rc=0} 09:17:20.000873 bus /gobi_0: Setting Powered False 09:17:21.098048 bus /gobi_0: Setting Powered False 09:17:22.213665 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_sms:trx-lms --------------------------------------------------------------------- 09:17:23.458785 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:23.462880 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:17:23.494999 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:17:23.502147 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:17:23.554225 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:17:23.588280 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:17:23.595813 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:17:24.131366 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:17:24.137288 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 09:17:24.148648 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 09:17:24.195524 tst mo_mt_sms.py: using LAC 32968 09:17:24.308597 tst mo_mt_sms.py: using RAC 73 09:17:24.421384 tst mo_mt_sms.py: using CellId 32968 09:17:24.534761 tst mo_mt_sms.py: using BVCI 32969 09:17:24.639277 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:17:24.755954 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:17:24.870153 tst mo_mt_sms.py:9: start nitb and bts... 09:17:25.064598 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:17:25.654361 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30704): Launched 09:17:25.941668 run osmo-nitb_10.42.42.2(pid=30705): Launched 09:17:26.101996 run osmo-nitb_10.42.42.2(pid=30705): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30705)] 09:17:26.232359 run osmo-nitb_10.42.42.2(pid=30705): stdout: | (launched: 2022-12-13_09:17:25.889452) 09:17:26.365126 run osmo-nitb_10.42.42.2(pid=30705): stderr: | (launched: 2022-12-13_09:17:25.932155) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:17:26.497319 run osmo-nitb_10.42.42.2(pid=30705): stdout: | (launched: 2022-12-13_09:17:25.889452) 09:17:26.624055 run osmo-nitb_10.42.42.2(pid=30705): stderr: | (launched: 2022-12-13_09:17:25.932155) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30705) [trial-2387↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30705)] 09:17:27.050030 tst osmo-nitb_10.42.42.2(pid=30705): stdout: | (launched: 2022-12-13_09:17:25.889452) 09:17:27.167672 tst osmo-nitb_10.42.42.2(pid=30705): stderr: | (launched: 2022-12-13_09:17:25.932155) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:17:27.306030 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30705) [trial-2387↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30705)] [trial-2387↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 09:17:27.314550 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 09:17:27.321295 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30704): Terminating (SIGTERM) 09:17:27.529624 --- ParallelTerminationStrategy: PID 30704 died... 09:17:27.550287 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30704): Terminated: ok {rc=0} 09:17:27.635591 bus /sierra_3: Setting Powered False 09:17:28.733792 bus /sierra_3: Setting Powered False 09:17:29.846321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:trx-lms --------------------------------------------------------------------- 09:17:31.043863 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:31.048167 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:17:31.081338 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:17:31.110756 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:17:31.165631 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:17:31.207502 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:17:31.244075 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:17:31.767032 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:17:31.773760 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:31.785615 tst sms:trx-lms: Using 1 x bts (candidates: 1) 09:17:31.839860 tst mo_mt_sms.py: using LAC 32969 09:17:31.963260 tst mo_mt_sms.py: using RAC 74 09:17:32.081367 tst mo_mt_sms.py: using CellId 32969 09:17:32.207194 tst mo_mt_sms.py: using BVCI 32970 09:17:32.327457 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:32.338498 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:32.349419 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:32.360063 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:32.370874 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:32.381715 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:17:32.497433 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:17:32.616914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:33.066300 run create_hlr_db(pid=30709): Launched 09:17:33.175677 bus /sierra_2: Setting Powered False 09:17:34.233333 run create_hlr_db(pid=30709): Terminated: ok {rc=0} 09:17:34.657669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Launched 09:17:34.967114 run osmo-hlr_10.42.42.2(pid=30712): Launched 09:17:35.085412 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:35.617706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Launched 09:17:35.925253 run osmo-stp_10.42.42.5(pid=30715): Launched 09:17:36.042843 run osmo-msc_10.42.42.6: Starting osmo-msc 09:17:36.602425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30717): Launched 09:17:36.910589 run osmo-msc_10.42.42.6(pid=30718): Launched 09:17:37.083675 run osmo-stp_10.42.42.5(pid=30715): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] 09:17:37.216424 run osmo-stp_10.42.42.5(pid=30715): stdout: | (launched: 2022-12-13_09:17:35.869580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:37.347519 run osmo-stp_10.42.42.5(pid=30715): stderr: | 20221213091736058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091736058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091736058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091736059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091736059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091736059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091736059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:37.477418 run osmo-stp_10.42.42.5(pid=30715): stdout: | (launched: 2022-12-13_09:17:35.869580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:37.601151 run osmo-stp_10.42.42.5(pid=30715): stderr: | 20221213091736058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091736058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091736058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091736059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091736059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091736059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091736059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:37.748677 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30715): Process ended prematurely: osmo-stp_10.42.42.5(pid=30715) [trial-2387↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] [trial-2387↪sms:trx-lms↪mo_mt_sms.py:16] 09:17:37.757708 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 09:17:37.784709 run osmo-hlr_10.42.42.2(pid=30712): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30712)] 09:17:37.834242 run osmo-hlr_10.42.42.2(pid=30712): stdout: | (launched: 2022-12-13_09:17:34.910990) 09:17:37.885443 run osmo-hlr_10.42.42.2(pid=30712): stderr: | 20221213091735105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091735105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091735105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091735105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091735105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091735106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091735117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091735125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091735125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091735125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:37.957036 run osmo-msc_10.42.42.6(pid=30718): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30718)] 09:17:38.006132 run osmo-msc_10.42.42.6(pid=30718): stdout: | (launched: 2022-12-13_09:17:36.854742) 09:17:38.057326 run osmo-msc_10.42.42.6(pid=30718): stderr: | 20221213091737171 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091737171 DLGLOBAL DEBUG validating counter group 0x7f1e5c95dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091737171 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091737171 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091737172 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091737172 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091737174 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091737174 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091737174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091737174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:38.109239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminating (SIGTERM) 09:17:38.150562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Terminating (SIGTERM) 09:17:38.192466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30717): Terminating (SIGTERM) 09:17:38.234491 --- ParallelTerminationStrategy: PID 30711 died... 09:17:38.254752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminated: ok {rc=0} 09:17:38.300652 --- ParallelTerminationStrategy: PID 30714 died... 09:17:38.320150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30714): Terminated: ok {rc=0} 09:17:38.365875 --- ParallelTerminationStrategy: PID 30717 died... 09:17:38.385368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30717): Terminated: ok {rc=0} 09:17:38.471613 bus /sierra_3: Setting Powered False 09:17:39.570867 bus /sierra_3: Setting Powered False 09:17:40.687525 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-lms --------------------------------------------------------------------- 09:17:41.919868 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:41.923812 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:17:41.957111 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:17:41.964072 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:17:41.999314 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:17:42.033206 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:17:42.040114 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:17:42.559916 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 09:17:42.564909 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 09:17:42.575979 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 09:17:42.626829 tst assert_extension.py: using LAC 32970 09:17:42.745650 tst assert_extension.py: using RAC 75 09:17:42.864446 tst assert_extension.py: using CellId 32970 09:17:42.983399 tst assert_extension.py: using BVCI 32971 09:17:43.094632 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 09:17:43.209720 tst assert_extension.py:10: start nitb and bts... 09:17:43.417582 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:17:44.049266 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30723): Launched 09:17:44.356632 run osmo-nitb_10.42.42.2(pid=30724): Launched 09:17:44.527338 run osmo-nitb_10.42.42.2(pid=30724): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] 09:17:44.665859 run osmo-nitb_10.42.42.2(pid=30724): stdout: | (launched: 2022-12-13_09:17:44.300323) 09:17:44.805948 run osmo-nitb_10.42.42.2(pid=30724): stderr: | (launched: 2022-12-13_09:17:44.346793) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:17:44.946149 run osmo-nitb_10.42.42.2(pid=30724): stdout: | (launched: 2022-12-13_09:17:44.300323) 09:17:45.080520 run osmo-nitb_10.42.42.2(pid=30724): stderr: | (launched: 2022-12-13_09:17:44.346793) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30724) [trial-2387↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] 09:17:45.472679 tst osmo-nitb_10.42.42.2(pid=30724): stdout: | (launched: 2022-12-13_09:17:44.300323) 09:17:45.597970 tst osmo-nitb_10.42.42.2(pid=30724): stderr: | (launched: 2022-12-13_09:17:44.346793) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:17:45.745283 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30724) [trial-2387↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] [trial-2387↪nitb_ussd:trx-lms↪assert_extension.py:12] 09:17:45.754196 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:17:45.761087 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30723): Terminating (SIGTERM) 09:17:45.970324 --- ParallelTerminationStrategy: PID 30723 died... 09:17:46.004250 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30723): Terminated: ok {rc=0} 09:17:46.120396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:trx-lms --------------------------------------------------------------------- 09:17:47.298649 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:47.302895 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:17:47.337132 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:17:47.364739 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:17:47.398945 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:17:47.433010 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:17:47.460859 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:17:47.989807 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:trx-lms assert_extension.py ---------------------------------------------- 09:17:47.995082 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:48.006162 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 09:17:48.053044 tst assert_extension.py: using LAC 32971 09:17:48.172398 tst assert_extension.py: using RAC 76 09:17:48.292133 tst assert_extension.py: using CellId 32971 09:17:48.412171 tst assert_extension.py: using BVCI 32972 09:17:48.524696 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:48.535635 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:48.546510 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:48.557236 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:48.568451 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:17:48.579491 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 09:17:48.693282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:49.140690 run create_hlr_db(pid=30728): Launched 09:17:49.251556 bus /sierra_2: Setting Powered False 09:17:50.309479 run create_hlr_db(pid=30728): Terminated: ok {rc=0} 09:17:50.712382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Launched 09:17:50.999412 run osmo-hlr_10.42.42.2(pid=30731): Launched 09:17:51.109707 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:51.620765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Launched 09:17:51.909265 run osmo-stp_10.42.42.5(pid=30734): Launched 09:17:52.020577 run osmo-msc_10.42.42.6: Starting osmo-msc 09:17:52.541914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Launched 09:17:52.831368 run osmo-msc_10.42.42.6(pid=30737): Launched 09:17:52.993413 run osmo-stp_10.42.42.5(pid=30734): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] 09:17:53.117240 run osmo-stp_10.42.42.5(pid=30734): stdout: | (launched: 2022-12-13_09:17:51.856278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:53.241046 run osmo-stp_10.42.42.5(pid=30734): stderr: | 20221213091752024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091752024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091752025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091752025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091752026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091752026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091752026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:53.362172 run osmo-stp_10.42.42.5(pid=30734): stdout: | (launched: 2022-12-13_09:17:51.856278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:53.478202 run osmo-stp_10.42.42.5(pid=30734): stderr: | 20221213091752024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091752024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091752025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091752025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091752026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091752026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091752026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:53.616854 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30734): Process ended prematurely: osmo-stp_10.42.42.5(pid=30734) [trial-2387↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] [trial-2387↪ussd:trx-lms↪assert_extension.py:17] 09:17:53.625215 tst assert_extension.py:17: Test FAILED (5.6 sec) 09:17:53.650746 run osmo-hlr_10.42.42.2(pid=30731): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30731)] 09:17:53.698406 run osmo-hlr_10.42.42.2(pid=30731): stdout: | (launched: 2022-12-13_09:17:50.947189) 09:17:53.747507 run osmo-hlr_10.42.42.2(pid=30731): stderr: | 20221213091751121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091751121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091751121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091751121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091751121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091751121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091751134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091751142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091751143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091751143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:53.816550 run osmo-msc_10.42.42.6(pid=30737): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30737)] 09:17:53.863747 run osmo-msc_10.42.42.6(pid=30737): stdout: | (launched: 2022-12-13_09:17:52.778646) 09:17:53.912860 run osmo-msc_10.42.42.6(pid=30737): stderr: | 20221213091753048 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091753048 DLGLOBAL DEBUG validating counter group 0x7fb66b084c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091753048 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091753048 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091753048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091753049 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091753050 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091753051 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091753051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091753051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:53.962469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Terminating (SIGTERM) 09:17:54.002204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Terminating (SIGTERM) 09:17:54.041958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Terminating (SIGTERM) 09:17:54.081903 --- ParallelTerminationStrategy: PID 30730 died... 09:17:54.101296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Terminated: ok {rc=0} 09:17:54.145213 --- ParallelTerminationStrategy: PID 30733 died... 09:17:54.163919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Terminated: ok {rc=0} 09:17:54.207516 --- ParallelTerminationStrategy: PID 30736 died... 09:17:54.226243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Terminated: ok {rc=0} 09:17:54.311805 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:17:55.524483 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:55.531518 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:17:55.565340 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:17:55.593869 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:17:55.647417 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:17:55.681103 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:17:55.707648 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:17:56.256236 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:17:56.304544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:17:56.315640 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:17:56.383695 tst mo_mt_call.py: using LAC 32972 09:17:56.503128 tst mo_mt_call.py: using RAC 77 09:17:56.617373 tst mo_mt_call.py: using CellId 32972 09:17:56.730512 tst mo_mt_call.py: using BVCI 32973 09:17:56.836440 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:17:56.847552 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:17:56.858511 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:17:56.869488 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:17:56.880496 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:17:56.891752 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:17:57.009228 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:17:57.125602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:57.614178 run create_hlr_db(pid=30743): Launched 09:17:57.742544 bus /sierra_2: Setting Powered False 09:17:58.804788 run create_hlr_db(pid=30743): Terminated: ok {rc=0} 09:17:59.224529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30745): Launched 09:17:59.517514 run osmo-hlr_10.42.42.2(pid=30746): Launched 09:17:59.630664 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:00.151207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30748): Launched 09:18:00.444520 run osmo-stp_10.42.42.5(pid=30749): Launched 09:18:00.557534 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:01.126876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30751): Launched 09:18:01.466096 run osmo-msc_10.42.42.6(pid=30752): Launched 09:18:01.884489 run osmo-stp_10.42.42.5(pid=30749): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30749)] 09:18:02.104652 run osmo-stp_10.42.42.5(pid=30749): stdout: | (launched: 2022-12-13_09:18:00.390943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:02.231223 run osmo-stp_10.42.42.5(pid=30749): stderr: | 20221213091800560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091800560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091800561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091800561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091800563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091800563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091800564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:02.355828 run osmo-stp_10.42.42.5(pid=30749): stdout: | (launched: 2022-12-13_09:18:00.390943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:02.474159 run osmo-stp_10.42.42.5(pid=30749): stderr: | 20221213091800560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091800560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091800561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091800561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091800563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091800563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091800564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:02.615387 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30749): Process ended prematurely: osmo-stp_10.42.42.5(pid=30749) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30749)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:18:02.624507 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:18:02.650741 run osmo-hlr_10.42.42.2(pid=30746): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30746)] 09:18:02.698740 run osmo-hlr_10.42.42.2(pid=30746): stdout: | (launched: 2022-12-13_09:17:59.464216) 09:18:02.748058 run osmo-hlr_10.42.42.2(pid=30746): stderr: | 20221213091759640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091759640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091759640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091759640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091759640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091759640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091759652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091759661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091759661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091759662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:02.816916 run osmo-msc_10.42.42.6(pid=30752): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30752)] 09:18:02.864365 run osmo-msc_10.42.42.6(pid=30752): stdout: | (launched: 2022-12-13_09:18:01.403603) 09:18:02.913629 run osmo-msc_10.42.42.6(pid=30752): stderr: | 20221213091801782 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091801783 DLGLOBAL DEBUG validating counter group 0x7fe56e952c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091801783 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091801783 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091801783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091801783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091801785 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091801786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091801786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091801786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:02.963190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30745): Terminating (SIGTERM) 09:18:03.003066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30748): Terminating (SIGTERM) 09:18:03.042845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30751): Terminating (SIGTERM) 09:18:03.082999 --- ParallelTerminationStrategy: PID 30745 died... 09:18:03.102500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30745): Terminated: ok {rc=0} 09:18:03.146683 --- ParallelTerminationStrategy: PID 30748 died... 09:18:03.165582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30748): Terminated: ok {rc=0} 09:18:03.209287 --- ParallelTerminationStrategy: PID 30751 died... 09:18:03.228205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30751): Terminated: ok {rc=0} 09:18:03.311520 bus /sierra_3: Setting Powered False 09:18:04.405775 bus /sierra_3: Setting Powered False 09:18:05.520372 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:18:06.665395 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:06.676886 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:18:06.745863 tst mo_mt_call_osmux.py: using LAC 32973 09:18:06.867600 tst mo_mt_call_osmux.py: using RAC 78 09:18:06.983423 tst mo_mt_call_osmux.py: using CellId 32973 09:18:07.100041 tst mo_mt_call_osmux.py: using BVCI 32974 09:18:07.207513 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:07.218530 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:07.229280 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:07.239955 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:07.251096 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:07.262268 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:18:07.382597 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:18:07.503020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:07.960208 run create_hlr_db(pid=30754): Launched 09:18:08.072851 bus /sierra_2: Setting Powered False 09:18:09.132563 run create_hlr_db(pid=30754): Terminated: ok {rc=0} 09:18:09.565026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Launched 09:18:09.880412 run osmo-hlr_10.42.42.2(pid=30757): Launched 09:18:10.000602 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:10.545273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Launched 09:18:10.859427 run osmo-stp_10.42.42.5(pid=30760): Launched 09:18:10.978894 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:11.549187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Launched 09:18:11.863583 run osmo-msc_10.42.42.6(pid=30764): Launched 09:18:12.038675 run osmo-stp_10.42.42.5(pid=30760): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] 09:18:12.171639 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-13_09:18:10.802439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:12.305192 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221213091810994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091810994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091810994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091810995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091810995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091810995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091810995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:12.438591 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-13_09:18:10.802439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:12.564742 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221213091810994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091810994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091810994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091810995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091810995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091810995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091810995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:12.715317 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:18:12.725034 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:18:12.752551 run osmo-hlr_10.42.42.2(pid=30757): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30757)] 09:18:12.802242 run osmo-hlr_10.42.42.2(pid=30757): stdout: | (launched: 2022-12-13_09:18:09.823605) 09:18:12.853430 run osmo-hlr_10.42.42.2(pid=30757): stderr: | 20221213091810020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091810020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091810020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091810020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091810020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091810020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091810032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091810041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091810041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091810041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:12.924796 run osmo-msc_10.42.42.6(pid=30764): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30764)] 09:18:12.974115 run osmo-msc_10.42.42.6(pid=30764): stdout: | (launched: 2022-12-13_09:18:11.806445) 09:18:13.025249 run osmo-msc_10.42.42.6(pid=30764): stderr: | 20221213091812127 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091812127 DLGLOBAL DEBUG validating counter group 0x7fc61b25ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091812128 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091812128 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091812128 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091812128 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091812130 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091812130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091812130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091812131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:13.076598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminating (SIGTERM) 09:18:13.117768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminating (SIGTERM) 09:18:13.159141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Terminating (SIGTERM) 09:18:13.200498 --- ParallelTerminationStrategy: PID 30756 died... 09:18:13.220377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminated: ok {rc=0} 09:18:13.265963 --- ParallelTerminationStrategy: PID 30759 died... 09:18:13.285411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminated: ok {rc=0} 09:18:13.330953 --- ParallelTerminationStrategy: PID 30762 died... 09:18:13.350351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Terminated: ok {rc=0} 09:18:13.436414 bus /sierra_3: Setting Powered False 09:18:14.534234 bus /sierra_3: Setting Powered False 09:18:15.645845 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:18:16.891939 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:16.898941 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:18:16.936318 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:18:16.965368 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:18:17.024146 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:18:17.074371 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:18:17.104768 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:18:17.637995 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:18:17.690670 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:17.702236 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:18:17.779532 tst mo_mt_call.py: using LAC 32974 09:18:17.905411 tst mo_mt_call.py: using RAC 79 09:18:18.022830 tst mo_mt_call.py: using CellId 32974 09:18:18.143550 tst mo_mt_call.py: using BVCI 32975 09:18:18.251679 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:18.262715 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:18.273800 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:18.284465 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:18.295628 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:18.306697 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:18:18.426743 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:18:18.545190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:19.001305 run create_hlr_db(pid=30769): Launched 09:18:19.113702 bus /sierra_2: Setting Powered False 09:18:20.173340 run create_hlr_db(pid=30769): Terminated: ok {rc=0} 09:18:20.585201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30771): Launched 09:18:20.880011 run osmo-hlr_10.42.42.2(pid=30772): Launched 09:18:20.992709 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:21.518563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30774): Launched 09:18:21.812136 run osmo-stp_10.42.42.5(pid=30775): Launched 09:18:21.925250 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:22.457634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30777): Launched 09:18:22.752440 run osmo-msc_10.42.42.6(pid=30778): Launched 09:18:22.918223 run osmo-stp_10.42.42.5(pid=30775): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30775)] 09:18:23.044066 run osmo-stp_10.42.42.5(pid=30775): stdout: | (launched: 2022-12-13_09:18:21.758434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:23.169578 run osmo-stp_10.42.42.5(pid=30775): stderr: | 20221213091821927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091821927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091821927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091821927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091821928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091821928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091821928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:23.292772 run osmo-stp_10.42.42.5(pid=30775): stdout: | (launched: 2022-12-13_09:18:21.758434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:23.410609 run osmo-stp_10.42.42.5(pid=30775): stderr: | 20221213091821927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091821927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091821927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091821927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091821928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091821928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091821928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:23.551433 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30775): Process ended prematurely: osmo-stp_10.42.42.5(pid=30775) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30775)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:18:23.560479 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:18:23.586691 run osmo-hlr_10.42.42.2(pid=30772): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30772)] 09:18:23.634543 run osmo-hlr_10.42.42.2(pid=30772): stdout: | (launched: 2022-12-13_09:18:20.826696) 09:18:23.683665 run osmo-hlr_10.42.42.2(pid=30772): stderr: | 20221213091821000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091821000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091821000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091821000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091821000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091821000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091821013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091821021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091821022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091821022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:23.752578 run osmo-msc_10.42.42.6(pid=30778): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30778)] 09:18:23.799862 run osmo-msc_10.42.42.6(pid=30778): stdout: | (launched: 2022-12-13_09:18:22.698671) 09:18:23.849601 run osmo-msc_10.42.42.6(pid=30778): stderr: | 20221213091822970 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091822970 DLGLOBAL DEBUG validating counter group 0x7f85694d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091822970 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091822970 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091822970 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091822970 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091822972 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091822972 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091822972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091822973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:23.899333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30771): Terminating (SIGTERM) 09:18:23.939169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30774): Terminating (SIGTERM) 09:18:23.978908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30777): Terminating (SIGTERM) 09:18:24.018848 --- ParallelTerminationStrategy: PID 30771 died... 09:18:24.038336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30771): Terminated: ok {rc=0} 09:18:24.082259 --- ParallelTerminationStrategy: PID 30774 died... 09:18:24.101073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30774): Terminated: ok {rc=0} 09:18:24.144846 --- ParallelTerminationStrategy: PID 30777 died... 09:18:24.164188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30777): Terminated: ok {rc=0} 09:18:24.249858 bus /sierra_3: Setting Powered False 09:18:25.348223 bus /sierra_3: Setting Powered False 09:18:26.461582 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:18:27.606754 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:27.618451 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:18:27.687260 tst mo_mt_call_osmux.py: using LAC 32975 09:18:27.803504 tst mo_mt_call_osmux.py: using RAC 80 09:18:27.921724 tst mo_mt_call_osmux.py: using CellId 32975 09:18:28.048195 tst mo_mt_call_osmux.py: using BVCI 32976 09:18:28.164568 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:28.176280 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:28.187888 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:28.199435 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:28.210977 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:18:28.222441 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:18:28.337975 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:18:28.457790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:28.946048 run create_hlr_db(pid=30780): Launched 09:18:29.072932 bus /sierra_2: Setting Powered False 09:18:30.136178 run create_hlr_db(pid=30780): Terminated: ok {rc=0} 09:18:30.556172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30782): Launched 09:18:30.861928 run osmo-hlr_10.42.42.2(pid=30783): Launched 09:18:31.077358 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:31.699843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30785): Launched 09:18:32.014862 run osmo-stp_10.42.42.5(pid=30786): Launched 09:18:32.306104 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:32.906696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30788): Launched 09:18:33.200301 run osmo-msc_10.42.42.6(pid=30789): Launched 09:18:33.365650 run osmo-stp_10.42.42.5(pid=30786): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30786)] 09:18:33.491754 run osmo-stp_10.42.42.5(pid=30786): stdout: | (launched: 2022-12-13_09:18:31.950690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:33.617902 run osmo-stp_10.42.42.5(pid=30786): stderr: | 20221213091832181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091832182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091832182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091832182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091832184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091832185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091832185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:33.741574 run osmo-stp_10.42.42.5(pid=30786): stdout: | (launched: 2022-12-13_09:18:31.950690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:33.859679 run osmo-stp_10.42.42.5(pid=30786): stderr: | 20221213091832181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091832182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091832182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091832182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091832184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091832185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091832185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:34.001736 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30786): Process ended prematurely: osmo-stp_10.42.42.5(pid=30786) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30786)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:18:34.010693 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:18:34.037061 run osmo-hlr_10.42.42.2(pid=30783): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30783)] 09:18:34.085463 run osmo-hlr_10.42.42.2(pid=30783): stdout: | (launched: 2022-12-13_09:18:30.796669) 09:18:34.135346 run osmo-hlr_10.42.42.2(pid=30783): stderr: | 20221213091831140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091831140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091831141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091831141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091831141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091831141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091831156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091831165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091831165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091831165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:34.204854 run osmo-msc_10.42.42.6(pid=30789): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30789)] 09:18:34.252356 run osmo-msc_10.42.42.6(pid=30789): stdout: | (launched: 2022-12-13_09:18:33.146812) 09:18:34.302195 run osmo-msc_10.42.42.6(pid=30789): stderr: | 20221213091833416 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091833416 DLGLOBAL DEBUG validating counter group 0x7f080b03cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091833416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091833416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091833416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091833417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091833418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091833419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091833419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091833419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:34.352118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30782): Terminating (SIGTERM) 09:18:34.392134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30785): Terminating (SIGTERM) 09:18:34.432054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30788): Terminating (SIGTERM) 09:18:34.472255 --- ParallelTerminationStrategy: PID 30782 died... 09:18:34.491908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30782): Terminated: ok {rc=0} 09:18:34.536331 --- ParallelTerminationStrategy: PID 30785 died... 09:18:34.555541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30785): Terminated: ok {rc=0} 09:18:34.599870 --- ParallelTerminationStrategy: PID 30788 died... 09:18:34.619135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30788): Terminated: ok {rc=0} 09:18:34.703913 bus /sierra_3: Setting Powered False 09:18:35.801369 bus /sierra_3: Setting Powered False 09:18:36.917249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:18:38.170466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:38.176826 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:18:38.209520 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:18:38.237240 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:18:38.286666 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:18:38.319028 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:18:38.345551 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:18:38.897738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:18:38.945561 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:38.956591 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:18:39.023325 tst mo_mt_call.py: using LAC 32976 09:18:39.137091 tst mo_mt_call.py: using RAC 81 09:18:39.250667 tst mo_mt_call.py: using CellId 32976 09:18:39.364763 tst mo_mt_call.py: using BVCI 32977 09:18:39.470880 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:39.482099 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:39.492821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:39.503743 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:39.515057 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:39.526376 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:18:39.645532 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:18:39.765915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:40.223903 run create_hlr_db(pid=30794): Launched 09:18:40.337249 bus /sierra_2: Setting Powered False 09:18:41.396913 run create_hlr_db(pid=30794): Terminated: ok {rc=0} 09:18:41.828774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30796): Launched 09:18:42.145442 run osmo-hlr_10.42.42.2(pid=30797): Launched 09:18:42.266583 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:42.810643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30799): Launched 09:18:43.124809 run osmo-stp_10.42.42.5(pid=30800): Launched 09:18:43.244385 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:43.814063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30802): Launched 09:18:44.128030 run osmo-msc_10.42.42.6(pid=30803): Launched 09:18:44.303777 run osmo-stp_10.42.42.5(pid=30800): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30800)] 09:18:44.437873 run osmo-stp_10.42.42.5(pid=30800): stdout: | (launched: 2022-12-13_09:18:43.067518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:44.572132 run osmo-stp_10.42.42.5(pid=30800): stderr: | 20221213091843256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091843256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091843256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091843256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091843259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091843259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091843259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:44.704669 run osmo-stp_10.42.42.5(pid=30800): stdout: | (launched: 2022-12-13_09:18:43.067518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:44.830269 run osmo-stp_10.42.42.5(pid=30800): stderr: | 20221213091843256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091843256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091843256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091843256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091843259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091843259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091843259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:44.980138 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30800): Process ended prematurely: osmo-stp_10.42.42.5(pid=30800) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30800)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:18:44.989471 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:18:45.016904 run osmo-hlr_10.42.42.2(pid=30797): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30797)] 09:18:45.066669 run osmo-hlr_10.42.42.2(pid=30797): stdout: | (launched: 2022-12-13_09:18:42.088077) 09:18:45.117861 run osmo-hlr_10.42.42.2(pid=30797): stderr: | 20221213091842285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091842285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091842285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091842285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091842285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091842286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091842299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091842309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091842309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091842310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:45.188862 run osmo-msc_10.42.42.6(pid=30803): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30803)] 09:18:45.238042 run osmo-msc_10.42.42.6(pid=30803): stdout: | (launched: 2022-12-13_09:18:44.071262) 09:18:45.289075 run osmo-msc_10.42.42.6(pid=30803): stderr: | 20221213091844391 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091844391 DLGLOBAL DEBUG validating counter group 0x7fcc203f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091844391 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091844391 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091844391 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091844391 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091844393 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091844394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091844394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091844394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:45.340423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30796): Terminating (SIGTERM) 09:18:45.381460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30799): Terminating (SIGTERM) 09:18:45.422472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30802): Terminating (SIGTERM) 09:18:45.463769 --- ParallelTerminationStrategy: PID 30796 died... 09:18:45.483878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30796): Terminated: ok {rc=0} 09:18:45.529490 --- ParallelTerminationStrategy: PID 30799 died... 09:18:45.548891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30799): Terminated: ok {rc=0} 09:18:45.594606 --- ParallelTerminationStrategy: PID 30802 died... 09:18:45.613949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30802): Terminated: ok {rc=0} 09:18:45.701063 bus /sierra_3: Setting Powered False 09:18:46.795031 bus /sierra_3: Setting Powered False 09:18:47.907479 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:18:49.054488 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:49.066473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:18:49.138158 tst mo_mt_call_osmux.py: using LAC 32977 09:18:49.257031 tst mo_mt_call_osmux.py: using RAC 82 09:18:49.374369 tst mo_mt_call_osmux.py: using CellId 32977 09:18:49.490034 tst mo_mt_call_osmux.py: using BVCI 32978 09:18:49.596667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:49.607894 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:49.618942 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:49.629703 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:49.640811 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:18:49.651879 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:18:49.769975 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:18:49.885566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:50.343022 run create_hlr_db(pid=30805): Launched 09:18:50.455178 bus /sierra_2: Setting Powered False 09:18:51.514242 run create_hlr_db(pid=30805): Terminated: ok {rc=0} 09:18:51.945523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30807): Launched 09:18:52.260050 run osmo-hlr_10.42.42.2(pid=30808): Launched 09:18:52.380915 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:52.923764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30810): Launched 09:18:53.237308 run osmo-stp_10.42.42.5(pid=30811): Launched 09:18:53.358082 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:53.929816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30813): Launched 09:18:54.244049 run osmo-msc_10.42.42.6(pid=30814): Launched 09:18:54.420117 run osmo-stp_10.42.42.5(pid=30811): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30811)] 09:18:54.553744 run osmo-stp_10.42.42.5(pid=30811): stdout: | (launched: 2022-12-13_09:18:53.180383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:54.687278 run osmo-stp_10.42.42.5(pid=30811): stderr: | 20221213091853371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091853371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091853371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091853372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091853372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091853372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091853372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:54.819834 run osmo-stp_10.42.42.5(pid=30811): stdout: | (launched: 2022-12-13_09:18:53.180383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:54.945524 run osmo-stp_10.42.42.5(pid=30811): stderr: | 20221213091853371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091853371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091853371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091853372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091853372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091853372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091853372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:55.095961 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30811): Process ended prematurely: osmo-stp_10.42.42.5(pid=30811) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30811)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:18:55.105620 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:18:55.133432 run osmo-hlr_10.42.42.2(pid=30808): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30808)] 09:18:55.183400 run osmo-hlr_10.42.42.2(pid=30808): stdout: | (launched: 2022-12-13_09:18:52.203372) 09:18:55.234770 run osmo-hlr_10.42.42.2(pid=30808): stderr: | 20221213091852402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091852402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091852402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091852402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091852403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091852403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091852416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091852426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091852426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091852426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:55.307284 run osmo-msc_10.42.42.6(pid=30814): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30814)] 09:18:55.357256 run osmo-msc_10.42.42.6(pid=30814): stdout: | (launched: 2022-12-13_09:18:54.187087) 09:18:55.408638 run osmo-msc_10.42.42.6(pid=30814): stderr: | 20221213091854508 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091854508 DLGLOBAL DEBUG validating counter group 0x7f6980fe5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091854508 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091854509 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091854509 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091854509 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091854511 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091854511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091854511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091854511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:55.460562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30807): Terminating (SIGTERM) 09:18:55.502848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30810): Terminating (SIGTERM) 09:18:55.545265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30813): Terminating (SIGTERM) 09:18:55.587484 --- ParallelTerminationStrategy: PID 30807 died... 09:18:55.607045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30807): Terminated: ok {rc=0} 09:18:55.653044 --- ParallelTerminationStrategy: PID 30810 died... 09:18:55.672603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30810): Terminated: ok {rc=0} 09:18:55.718747 --- ParallelTerminationStrategy: PID 30813 died... 09:18:55.738378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30813): Terminated: ok {rc=0} 09:18:55.826023 bus /sierra_3: Setting Powered False 09:18:56.923464 bus /sierra_3: Setting Powered False 09:18:58.037914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:18:59.288456 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:59.295370 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:18:59.328808 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:18:59.356235 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:18:59.408151 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:18:59.441842 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:18:59.469332 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:19:00.021659 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:19:00.072101 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:00.083672 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:19:00.154797 tst mo_mt_call.py: using LAC 32978 09:19:00.278121 tst mo_mt_call.py: using RAC 83 09:19:00.402588 tst mo_mt_call.py: using CellId 32978 09:19:00.527952 tst mo_mt_call.py: using BVCI 32979 09:19:00.636505 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:00.647574 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:00.658298 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:00.669280 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:00.680491 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:00.691824 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:00.808445 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:00.938980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:01.477074 run create_hlr_db(pid=30819): Launched 09:19:01.623311 bus /sierra_2: Setting Powered False 09:19:02.685536 run create_hlr_db(pid=30819): Terminated: ok {rc=0} 09:19:03.106780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30821): Launched 09:19:03.400468 run osmo-hlr_10.42.42.2(pid=30822): Launched 09:19:03.512634 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:04.031103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30824): Launched 09:19:04.324637 run osmo-stp_10.42.42.5(pid=30825): Launched 09:19:04.437474 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:04.971358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30827): Launched 09:19:05.265174 run osmo-msc_10.42.42.6(pid=30828): Launched 09:19:05.430270 run osmo-stp_10.42.42.5(pid=30825): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30825)] 09:19:05.556070 run osmo-stp_10.42.42.5(pid=30825): stdout: | (launched: 2022-12-13_09:19:04.271320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:05.681522 run osmo-stp_10.42.42.5(pid=30825): stderr: | 20221213091904439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091904439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091904439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091904440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091904442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091904442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091904442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:05.804570 run osmo-stp_10.42.42.5(pid=30825): stdout: | (launched: 2022-12-13_09:19:04.271320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:05.922322 run osmo-stp_10.42.42.5(pid=30825): stderr: | 20221213091904439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091904439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091904439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091904440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091904442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091904442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091904442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:06.062964 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30825): Process ended prematurely: osmo-stp_10.42.42.5(pid=30825) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30825)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:19:06.071874 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:19:06.098192 run osmo-hlr_10.42.42.2(pid=30822): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30822)] 09:19:06.146138 run osmo-hlr_10.42.42.2(pid=30822): stdout: | (launched: 2022-12-13_09:19:03.346860) 09:19:06.195753 run osmo-hlr_10.42.42.2(pid=30822): stderr: | 20221213091903522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091903522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091903522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091903522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091903522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091903522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091903535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091903544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091903544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091903544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:06.264517 run osmo-msc_10.42.42.6(pid=30828): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30828)] 09:19:06.311589 run osmo-msc_10.42.42.6(pid=30828): stdout: | (launched: 2022-12-13_09:19:05.211458) 09:19:06.360614 run osmo-msc_10.42.42.6(pid=30828): stderr: | 20221213091905483 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091905483 DLGLOBAL DEBUG validating counter group 0x7f829e660c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091905483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091905483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091905483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091905484 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091905485 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091905486 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091905486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091905486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:06.410293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30821): Terminating (SIGTERM) 09:19:06.449584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30824): Terminating (SIGTERM) 09:19:06.489088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30827): Terminating (SIGTERM) 09:19:06.529193 --- ParallelTerminationStrategy: PID 30821 died... 09:19:06.548561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30821): Terminated: ok {rc=0} 09:19:06.592465 --- ParallelTerminationStrategy: PID 30824 died... 09:19:06.611154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30824): Terminated: ok {rc=0} 09:19:06.655024 --- ParallelTerminationStrategy: PID 30827 died... 09:19:06.674009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30827): Terminated: ok {rc=0} 09:19:06.759943 bus /sierra_3: Setting Powered False 09:19:07.857022 bus /sierra_3: Setting Powered False 09:19:08.971043 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:19:10.114810 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:10.126652 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:19:10.197411 tst mo_mt_call_osmux.py: using LAC 32979 09:19:10.314298 tst mo_mt_call_osmux.py: using RAC 84 09:19:10.431911 tst mo_mt_call_osmux.py: using CellId 32979 09:19:10.548605 tst mo_mt_call_osmux.py: using BVCI 32980 09:19:10.655653 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:10.666896 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:10.677926 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:10.688621 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:10.699914 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:10.711181 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:10.830988 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:10.947866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:11.405068 run create_hlr_db(pid=30830): Launched 09:19:11.517612 bus /sierra_2: Setting Powered False 09:19:12.576769 run create_hlr_db(pid=30830): Terminated: ok {rc=0} 09:19:13.007805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30832): Launched 09:19:13.323093 run osmo-hlr_10.42.42.2(pid=30833): Launched 09:19:13.444130 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:13.988695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30835): Launched 09:19:14.303294 run osmo-stp_10.42.42.5(pid=30836): Launched 09:19:14.423734 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:14.995758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30838): Launched 09:19:15.311867 run osmo-msc_10.42.42.6(pid=30839): Launched 09:19:15.488644 run osmo-stp_10.42.42.5(pid=30836): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30836)] 09:19:15.624090 run osmo-stp_10.42.42.5(pid=30836): stdout: | (launched: 2022-12-13_09:19:14.246167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:15.758538 run osmo-stp_10.42.42.5(pid=30836): stderr: | 20221213091914436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091914436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091914436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091914437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091914437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091914437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091914437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:15.901310 run osmo-stp_10.42.42.5(pid=30836): stdout: | (launched: 2022-12-13_09:19:14.246167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:16.040916 run osmo-stp_10.42.42.5(pid=30836): stderr: | 20221213091914436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091914436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091914436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091914437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091914437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091914437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091914437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:16.195677 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30836): Process ended prematurely: osmo-stp_10.42.42.5(pid=30836) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30836)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:19:16.205794 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:19:16.234807 run osmo-hlr_10.42.42.2(pid=30833): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30833)] 09:19:16.286369 run osmo-hlr_10.42.42.2(pid=30833): stdout: | (launched: 2022-12-13_09:19:13.266289) 09:19:16.339051 run osmo-hlr_10.42.42.2(pid=30833): stderr: | 20221213091913463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091913463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091913463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091913463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091913463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091913463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091913476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091913484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091913485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091913485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:16.413227 run osmo-msc_10.42.42.6(pid=30839): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30839)] 09:19:16.462417 run osmo-msc_10.42.42.6(pid=30839): stdout: | (launched: 2022-12-13_09:19:15.254465) 09:19:16.515459 run osmo-msc_10.42.42.6(pid=30839): stderr: | 20221213091915575 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091915575 DLGLOBAL DEBUG validating counter group 0x7f639dbccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091915575 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091915575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091915575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091915575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091915577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091915578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091915578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091915578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:16.568143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30832): Terminating (SIGTERM) 09:19:16.611842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30835): Terminating (SIGTERM) 09:19:16.656415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30838): Terminating (SIGTERM) 09:19:16.702667 --- ParallelTerminationStrategy: PID 30832 died... 09:19:16.724291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30832): Terminated: ok {rc=0} 09:19:16.772226 --- ParallelTerminationStrategy: PID 30835 died... 09:19:16.793148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30835): Terminated: ok {rc=0} 09:19:16.840161 --- ParallelTerminationStrategy: PID 30838 died... 09:19:16.861245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30838): Terminated: ok {rc=0} 09:19:16.950362 bus /sierra_3: Setting Powered False 09:19:18.045574 bus /sierra_3: Setting Powered False 09:19:19.160153 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:19:20.411263 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:19:20.417562 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:19:20.449563 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:19:20.476435 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:19:20.528223 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:19:20.561978 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:19:20.589520 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:19:21.135501 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:19:21.184334 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:21.195480 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:19:21.265953 tst mo_mt_call.py: using LAC 32980 09:19:21.380862 tst mo_mt_call.py: using RAC 85 09:19:21.495189 tst mo_mt_call.py: using CellId 32980 09:19:21.609285 tst mo_mt_call.py: using BVCI 32981 09:19:21.716344 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:21.727300 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:21.738084 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:21.748626 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:21.759819 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:21.770892 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:19:21.890341 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:19:22.007893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:22.464809 run create_hlr_db(pid=30844): Launched 09:19:22.577848 bus /sierra_2: Setting Powered False 09:19:23.636803 run create_hlr_db(pid=30844): Terminated: ok {rc=0} 09:19:24.048142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30846): Launched 09:19:24.342739 run osmo-hlr_10.42.42.2(pid=30847): Launched 09:19:24.455199 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:24.975445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30849): Launched 09:19:25.269143 run osmo-stp_10.42.42.5(pid=30850): Launched 09:19:25.381864 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:25.928560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30852): Launched 09:19:26.223040 run osmo-msc_10.42.42.6(pid=30853): Launched 09:19:26.388085 run osmo-stp_10.42.42.5(pid=30850): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30850)] 09:19:26.513775 run osmo-stp_10.42.42.5(pid=30850): stdout: | (launched: 2022-12-13_09:19:25.215384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:26.639348 run osmo-stp_10.42.42.5(pid=30850): stderr: | 20221213091925384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091925384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091925384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091925385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091925385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091925385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091925386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:26.762522 run osmo-stp_10.42.42.5(pid=30850): stdout: | (launched: 2022-12-13_09:19:25.215384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:26.880762 run osmo-stp_10.42.42.5(pid=30850): stderr: | 20221213091925384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091925384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091925384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091925385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091925385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091925385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091925386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:27.023247 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30850): Process ended prematurely: osmo-stp_10.42.42.5(pid=30850) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30850)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:19:27.032227 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:19:27.058621 run osmo-hlr_10.42.42.2(pid=30847): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30847)] 09:19:27.106593 run osmo-hlr_10.42.42.2(pid=30847): stdout: | (launched: 2022-12-13_09:19:24.288786) 09:19:27.155846 run osmo-hlr_10.42.42.2(pid=30847): stderr: | 20221213091924464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091924464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091924464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091924464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091924464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091924464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091924475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091924484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091924484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091924484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:27.224515 run osmo-msc_10.42.42.6(pid=30853): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30853)] 09:19:27.271482 run osmo-msc_10.42.42.6(pid=30853): stdout: | (launched: 2022-12-13_09:19:26.169447) 09:19:27.320835 run osmo-msc_10.42.42.6(pid=30853): stderr: | 20221213091926439 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091926439 DLGLOBAL DEBUG validating counter group 0x7efe28c61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091926439 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091926439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091926439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091926440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091926441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091926442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091926442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091926442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:27.370562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30846): Terminating (SIGTERM) 09:19:27.409975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30849): Terminating (SIGTERM) 09:19:27.449491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30852): Terminating (SIGTERM) 09:19:27.489423 --- ParallelTerminationStrategy: PID 30846 died... 09:19:27.508778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30846): Terminated: ok {rc=0} 09:19:27.552809 --- ParallelTerminationStrategy: PID 30849 died... 09:19:27.571718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30849): Terminated: ok {rc=0} 09:19:27.615399 --- ParallelTerminationStrategy: PID 30852 died... 09:19:27.634280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30852): Terminated: ok {rc=0} 09:19:27.719964 bus /sierra_3: Setting Powered False 09:19:28.818064 bus /sierra_3: Setting Powered False 09:19:29.929812 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:19:31.103578 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:31.120168 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:19:31.198104 tst mo_mt_call_osmux.py: using LAC 32981 09:19:31.320424 tst mo_mt_call_osmux.py: using RAC 86 09:19:31.478491 tst mo_mt_call_osmux.py: using CellId 32981 09:19:31.628098 tst mo_mt_call_osmux.py: using BVCI 32982 09:19:31.739750 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:31.751602 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:31.763090 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:31.774615 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:31.787289 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:19:31.799840 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:19:31.932921 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:19:32.056210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:32.555367 run create_hlr_db(pid=30855): Launched 09:19:32.676351 bus /sierra_2: Setting Powered False 09:19:33.735850 run create_hlr_db(pid=30855): Terminated: ok {rc=0} 09:19:34.167970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30857): Launched 09:19:34.483377 run osmo-hlr_10.42.42.2(pid=30858): Launched 09:19:34.604720 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:35.148863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30860): Launched 09:19:35.463421 run osmo-stp_10.42.42.5(pid=30861): Launched 09:19:35.583432 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:36.153513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30863): Launched 09:19:36.467773 run osmo-msc_10.42.42.6(pid=30864): Launched 09:19:36.645633 run osmo-stp_10.42.42.5(pid=30861): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30861)] 09:19:36.779818 run osmo-stp_10.42.42.5(pid=30861): stdout: | (launched: 2022-12-13_09:19:35.406360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:36.913138 run osmo-stp_10.42.42.5(pid=30861): stderr: | 20221213091935599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091935599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091935599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091935600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091935600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091935600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091935600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:37.045969 run osmo-stp_10.42.42.5(pid=30861): stdout: | (launched: 2022-12-13_09:19:35.406360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:37.171353 run osmo-stp_10.42.42.5(pid=30861): stderr: | 20221213091935599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091935599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091935599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091935600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091935600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091935600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091935600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:37.322142 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30861): Process ended prematurely: osmo-stp_10.42.42.5(pid=30861) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30861)] [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:19:37.331850 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:19:37.359497 run osmo-hlr_10.42.42.2(pid=30858): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30858)] 09:19:37.409356 run osmo-hlr_10.42.42.2(pid=30858): stdout: | (launched: 2022-12-13_09:19:34.426508) 09:19:37.460761 run osmo-hlr_10.42.42.2(pid=30858): stderr: | 20221213091934624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091934624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091934624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091934625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091934625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091934625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091934639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091934649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091934650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091934650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:37.533239 run osmo-msc_10.42.42.6(pid=30864): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30864)] 09:19:37.583122 run osmo-msc_10.42.42.6(pid=30864): stdout: | (launched: 2022-12-13_09:19:36.410599) 09:19:37.634470 run osmo-msc_10.42.42.6(pid=30864): stderr: | 20221213091936731 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091936731 DLGLOBAL DEBUG validating counter group 0x7f232a095c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091936731 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091936732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091936732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091936732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091936735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091936736 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091936736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091936736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:37.686080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30857): Terminating (SIGTERM) 09:19:37.727216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30860): Terminating (SIGTERM) 09:19:37.768431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30863): Terminating (SIGTERM) 09:19:37.810120 --- ParallelTerminationStrategy: PID 30857 died... 09:19:37.829983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30857): Terminated: ok {rc=0} 09:19:37.875712 --- ParallelTerminationStrategy: PID 30860 died... 09:19:37.895724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30860): Terminated: ok {rc=0} 09:19:37.941573 --- ParallelTerminationStrategy: PID 30863 died... 09:19:37.960917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30863): Terminated: ok {rc=0} 09:19:38.047459 bus /sierra_3: Setting Powered False 09:19:39.144746 bus /sierra_3: Setting Powered False 09:19:40.261102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:19:41.518225 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:19:41.525255 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:19:41.558693 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:19:41.586475 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:19:41.636692 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:19:41.670492 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:19:41.697646 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:19:42.251777 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:19:42.303529 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:42.315206 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:19:42.385803 tst mo_mt_call.py: using LAC 32982 09:19:42.508284 tst mo_mt_call.py: using RAC 87 09:19:42.630950 tst mo_mt_call.py: using CellId 32982 09:19:42.758183 tst mo_mt_call.py: using BVCI 32983 09:19:42.873472 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:42.884808 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:42.896128 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:42.907458 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:42.918887 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:42.930221 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:19:43.046033 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:19:43.166237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:43.655220 run create_hlr_db(pid=30870): Launched 09:19:43.783358 bus /sierra_2: Setting Powered False 09:19:44.845907 run create_hlr_db(pid=30870): Terminated: ok {rc=0} 09:19:45.267527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30872): Launched 09:19:45.563242 run osmo-hlr_10.42.42.2(pid=30873): Launched 09:19:45.677779 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:46.259191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30875): Launched 09:19:46.603546 run osmo-stp_10.42.42.5(pid=30876): Launched 09:19:46.739248 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:47.472055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30878): Launched 09:19:47.788467 run osmo-msc_10.42.42.6(pid=30879): Launched 09:19:47.965218 run osmo-stp_10.42.42.5(pid=30876): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30876)] 09:19:48.098769 run osmo-stp_10.42.42.5(pid=30876): stdout: | (launched: 2022-12-13_09:19:46.531735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:48.233144 run osmo-stp_10.42.42.5(pid=30876): stderr: | 20221213091946875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091946875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091946876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091946876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091946876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091946885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091946885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:48.366416 run osmo-stp_10.42.42.5(pid=30876): stdout: | (launched: 2022-12-13_09:19:46.531735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:48.492743 run osmo-stp_10.42.42.5(pid=30876): stderr: | 20221213091946875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091946875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091946876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091946876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091946876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091946885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091946885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:48.644440 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30876): Process ended prematurely: osmo-stp_10.42.42.5(pid=30876) [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30876)] [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:19:48.654192 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:19:48.681983 run osmo-hlr_10.42.42.2(pid=30873): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30873)] 09:19:48.732090 run osmo-hlr_10.42.42.2(pid=30873): stdout: | (launched: 2022-12-13_09:19:45.509644) 09:19:48.783739 run osmo-hlr_10.42.42.2(pid=30873): stderr: | 20221213091945685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091945685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091945685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091945685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091945685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091945685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091945697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091945706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091945706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091945706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:48.855809 run osmo-msc_10.42.42.6(pid=30879): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30879)] 09:19:48.905334 run osmo-msc_10.42.42.6(pid=30879): stdout: | (launched: 2022-12-13_09:19:47.731104) 09:19:48.957175 run osmo-msc_10.42.42.6(pid=30879): stderr: | 20221213091948052 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091948053 DLGLOBAL DEBUG validating counter group 0x7f1d397a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091948053 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091948053 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091948053 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091948053 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091948055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091948055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091948055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091948055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:49.009367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30872): Terminating (SIGTERM) 09:19:49.050587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30875): Terminating (SIGTERM) 09:19:49.091848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30878): Terminating (SIGTERM) 09:19:49.133401 --- ParallelTerminationStrategy: PID 30872 died... 09:19:49.153330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30872): Terminated: ok {rc=0} 09:19:49.199018 --- ParallelTerminationStrategy: PID 30875 died... 09:19:49.218287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30875): Terminated: ok {rc=0} 09:19:49.263767 --- ParallelTerminationStrategy: PID 30878 died... 09:19:49.283106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30878): Terminated: ok {rc=0} 09:19:49.369167 bus /sierra_3: Setting Powered False 09:19:50.466810 bus /sierra_3: Setting Powered False 09:19:51.581114 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:19:52.727194 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:52.739369 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:19:52.810849 tst mo_mt_call_osmux.py: using LAC 32983 09:19:52.936287 tst mo_mt_call_osmux.py: using RAC 88 09:19:53.061198 tst mo_mt_call_osmux.py: using CellId 32983 09:19:53.184751 tst mo_mt_call_osmux.py: using BVCI 32984 09:19:53.298519 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:53.310114 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:53.321564 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:53.333122 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:53.344530 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:19:53.355879 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:19:53.475228 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:19:53.590661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:54.079291 run create_hlr_db(pid=30881): Launched 09:19:54.207499 bus /sierra_2: Setting Powered False 09:19:55.270499 run create_hlr_db(pid=30881): Terminated: ok {rc=0} 09:19:55.694019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30883): Launched 09:19:55.989263 run osmo-hlr_10.42.42.2(pid=30884): Launched 09:19:56.101816 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:56.626092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30886): Launched 09:19:56.921101 run osmo-stp_10.42.42.5(pid=30887): Launched 09:19:57.034444 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:57.574012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30889): Launched 09:19:57.873799 run osmo-msc_10.42.42.6(pid=30890): Launched 09:19:58.039413 run osmo-stp_10.42.42.5(pid=30887): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30887)] 09:19:58.166086 run osmo-stp_10.42.42.5(pid=30887): stdout: | (launched: 2022-12-13_09:19:56.867018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:58.292324 run osmo-stp_10.42.42.5(pid=30887): stderr: | 20221213091957037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091957037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091957038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091957038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091957038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091957039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091957039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:58.416199 run osmo-stp_10.42.42.5(pid=30887): stdout: | (launched: 2022-12-13_09:19:56.867018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:58.534702 run osmo-stp_10.42.42.5(pid=30887): stderr: | 20221213091957037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213091957037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213091957038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213091957038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213091957038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213091957039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213091957039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:58.676926 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30887): Process ended prematurely: osmo-stp_10.42.42.5(pid=30887) [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30887)] [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:19:58.685932 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:19:58.712425 run osmo-hlr_10.42.42.2(pid=30884): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30884)] 09:19:58.760207 run osmo-hlr_10.42.42.2(pid=30884): stdout: | (launched: 2022-12-13_09:19:55.935564) 09:19:58.809268 run osmo-hlr_10.42.42.2(pid=30884): stderr: | 20221213091956109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213091956110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213091956110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213091956110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213091956110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213091956110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213091956122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213091956131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213091956131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213091956131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:58.878089 run osmo-msc_10.42.42.6(pid=30890): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30890)] 09:19:58.924893 run osmo-msc_10.42.42.6(pid=30890): stdout: | (launched: 2022-12-13_09:19:57.818542) 09:19:58.974234 run osmo-msc_10.42.42.6(pid=30890): stderr: | 20221213091958088 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213091958088 DLGLOBAL DEBUG validating counter group 0x7fbe6b3e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213091958089 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213091958089 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213091958089 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213091958089 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213091958091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213091958091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213091958091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213091958091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:59.023538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30883): Terminating (SIGTERM) 09:19:59.062861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30886): Terminating (SIGTERM) 09:19:59.102596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30889): Terminating (SIGTERM) 09:19:59.142561 --- ParallelTerminationStrategy: PID 30883 died... 09:19:59.161995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30883): Terminated: ok {rc=0} 09:19:59.205972 --- ParallelTerminationStrategy: PID 30886 died... 09:19:59.224576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30886): Terminated: ok {rc=0} 09:19:59.268371 --- ParallelTerminationStrategy: PID 30889 died... 09:19:59.287283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30889): Terminated: ok {rc=0} 09:19:59.372527 bus /sierra_3: Setting Powered False 09:20:00.469433 bus /sierra_3: Setting Powered False 09:20:01.588364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:20:02.840554 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:02.846237 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:20:02.878408 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:20:02.905754 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:20:02.956412 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:20:02.988428 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:20:03.015311 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:20:03.564198 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:20:03.613149 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:03.624072 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:03.698578 tst mo_mt_call.py: using LAC 32984 09:20:03.814522 tst mo_mt_call.py: using RAC 89 09:20:03.929286 tst mo_mt_call.py: using CellId 32984 09:20:04.044386 tst mo_mt_call.py: using BVCI 32985 09:20:04.152120 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:04.163045 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:04.173903 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:04.184548 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:04.196190 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:04.207642 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:04.326600 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:04.443195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:04.901960 run create_hlr_db(pid=30898): Launched 09:20:05.014335 bus /sierra_2: Setting Powered False 09:20:06.073357 run create_hlr_db(pid=30898): Terminated: ok {rc=0} 09:20:06.485042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Launched 09:20:06.780049 run osmo-hlr_10.42.42.2(pid=30901): Launched 09:20:06.892881 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:07.413640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Launched 09:20:07.730347 run osmo-stp_10.42.42.5(pid=30904): Launched 09:20:07.846551 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:08.382541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30906): Launched 09:20:08.677544 run osmo-msc_10.42.42.6(pid=30907): Launched 09:20:08.843099 run osmo-stp_10.42.42.5(pid=30904): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] 09:20:08.969249 run osmo-stp_10.42.42.5(pid=30904): stdout: | (launched: 2022-12-13_09:20:07.673315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:09.095159 run osmo-stp_10.42.42.5(pid=30904): stderr: | 20221213092007842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092007842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092007843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092007843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092007843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092007844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092007844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:09.218810 run osmo-stp_10.42.42.5(pid=30904): stdout: | (launched: 2022-12-13_09:20:07.673315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:09.337192 run osmo-stp_10.42.42.5(pid=30904): stderr: | 20221213092007842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092007842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092007843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092007843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092007843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092007844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092007844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:09.478591 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30904): Process ended prematurely: osmo-stp_10.42.42.5(pid=30904) [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:20:09.487593 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:20:09.513760 run osmo-hlr_10.42.42.2(pid=30901): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30901)] 09:20:09.561707 run osmo-hlr_10.42.42.2(pid=30901): stdout: | (launched: 2022-12-13_09:20:06.726536) 09:20:09.610612 run osmo-hlr_10.42.42.2(pid=30901): stderr: | 20221213092006901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092006901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092006901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092006901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092006901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092006901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092006914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092006922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092006922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092006922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:09.679343 run osmo-msc_10.42.42.6(pid=30907): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30907)] 09:20:09.726073 run osmo-msc_10.42.42.6(pid=30907): stdout: | (launched: 2022-12-13_09:20:08.623453) 09:20:09.775092 run osmo-msc_10.42.42.6(pid=30907): stderr: | 20221213092008894 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092008894 DLGLOBAL DEBUG validating counter group 0x7f3ded747c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092008894 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092008894 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092008894 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092008895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092008896 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092008897 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092008897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092008897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:09.824434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Terminating (SIGTERM) 09:20:09.863852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Terminating (SIGTERM) 09:20:09.903545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30906): Terminating (SIGTERM) 09:20:09.943368 --- ParallelTerminationStrategy: PID 30900 died... 09:20:09.962858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Terminated: ok {rc=0} 09:20:10.006768 --- ParallelTerminationStrategy: PID 30903 died... 09:20:10.025706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Terminated: ok {rc=0} 09:20:10.069351 --- ParallelTerminationStrategy: PID 30906 died... 09:20:10.088317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30906): Terminated: ok {rc=0} 09:20:10.174627 bus /sierra_3: Setting Powered False 09:20:11.272206 bus /sierra_3: Setting Powered False 09:20:12.386754 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:20:13.532174 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:13.543674 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:13.613832 tst mo_mt_call_osmux.py: using LAC 32985 09:20:13.731089 tst mo_mt_call_osmux.py: using RAC 90 09:20:13.847626 tst mo_mt_call_osmux.py: using CellId 32985 09:20:13.975864 tst mo_mt_call_osmux.py: using BVCI 32986 09:20:14.086466 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:14.097594 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:14.108041 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:14.118811 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:14.130048 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:14.141031 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:14.255556 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:14.374889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:14.864443 run create_hlr_db(pid=30909): Launched 09:20:14.993638 bus /sierra_2: Setting Powered False 09:20:16.061168 run create_hlr_db(pid=30909): Terminated: ok {rc=0} 09:20:16.518664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30911): Launched 09:20:16.847114 run osmo-hlr_10.42.42.2(pid=30912): Launched 09:20:16.975457 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:17.569703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30914): Launched 09:20:17.884346 run osmo-stp_10.42.42.5(pid=30915): Launched 09:20:18.003926 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:18.576564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30917): Launched 09:20:18.892403 run osmo-msc_10.42.42.6(pid=30918): Launched 09:20:19.068563 run osmo-stp_10.42.42.5(pid=30915): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30915)] 09:20:19.202197 run osmo-stp_10.42.42.5(pid=30915): stdout: | (launched: 2022-12-13_09:20:17.827229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:19.336055 run osmo-stp_10.42.42.5(pid=30915): stderr: | 20221213092018018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092018018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092018018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092018018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092018019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092018019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092018019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:19.468689 run osmo-stp_10.42.42.5(pid=30915): stdout: | (launched: 2022-12-13_09:20:17.827229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:19.595486 run osmo-stp_10.42.42.5(pid=30915): stderr: | 20221213092018018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092018018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092018018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092018018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092018019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092018019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092018019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:19.746610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30915): Process ended prematurely: osmo-stp_10.42.42.5(pid=30915) [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30915)] [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:20:19.755872 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:20:19.783703 run osmo-hlr_10.42.42.2(pid=30912): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30912)] 09:20:19.834013 run osmo-hlr_10.42.42.2(pid=30912): stdout: | (launched: 2022-12-13_09:20:16.788209) 09:20:19.885878 run osmo-hlr_10.42.42.2(pid=30912): stderr: | 20221213092017190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092017190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092017190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092017190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092017190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092017190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092017209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092017217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092017218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092017218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:19.958221 run osmo-msc_10.42.42.6(pid=30918): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30918)] 09:20:20.008189 run osmo-msc_10.42.42.6(pid=30918): stdout: | (launched: 2022-12-13_09:20:18.835126) 09:20:20.059841 run osmo-msc_10.42.42.6(pid=30918): stderr: | 20221213092019156 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092019156 DLGLOBAL DEBUG validating counter group 0x7fd9a09f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092019157 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092019157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092019157 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092019157 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092019159 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092019159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092019159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092019159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:20.111861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30911): Terminating (SIGTERM) 09:20:20.153597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30914): Terminating (SIGTERM) 09:20:20.195400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30917): Terminating (SIGTERM) 09:20:20.237485 --- ParallelTerminationStrategy: PID 30911 died... 09:20:20.257540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30911): Terminated: ok {rc=0} 09:20:20.303977 --- ParallelTerminationStrategy: PID 30914 died... 09:20:20.323509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30914): Terminated: ok {rc=0} 09:20:20.370100 --- ParallelTerminationStrategy: PID 30917 died... 09:20:20.389948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30917): Terminated: ok {rc=0} 09:20:20.478493 bus /sierra_3: Setting Powered False 09:20:21.577514 bus /sierra_3: Setting Powered False 09:20:22.694098 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:trx-lms --------------------------------------------------------------------- 09:20:23.938934 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:23.943391 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 09:20:23.975863 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:20:24.003622 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 09:20:24.086496 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 09:20:24.119106 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:20:24.145789 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 09:20:24.728094 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 09:20:24.733547 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:24.743896 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:20:24.791802 tst emergency_mo_mt_call.py: using LAC 32986 09:20:24.906285 tst emergency_mo_mt_call.py: using RAC 91 09:20:25.020044 tst emergency_mo_mt_call.py: using CellId 32986 09:20:25.133153 tst emergency_mo_mt_call.py: using BVCI 32987 09:20:25.239333 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:25.250179 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:25.260493 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:25.270866 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:25.281173 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:25.291964 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:20:25.410990 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:20:25.527530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:25.977121 run create_hlr_db(pid=30923): Launched 09:20:26.087497 bus /sierra_2: Setting Powered False 09:20:27.146503 run create_hlr_db(pid=30923): Terminated: ok {rc=0} 09:20:27.570924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30925): Launched 09:20:27.880787 run osmo-hlr_10.42.42.2(pid=30926): Launched 09:20:27.999262 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:28.533383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30928): Launched 09:20:28.842738 run osmo-stp_10.42.42.5(pid=30929): Launched 09:20:28.971210 tst emergency_mo_mt_call.py: using MSISDN 8080 09:20:29.130381 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:29.689709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30931): Launched 09:20:29.998932 run osmo-msc_10.42.42.6(pid=30932): Launched 09:20:30.171153 run osmo-stp_10.42.42.5(pid=30929): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30929)] 09:20:30.307081 run osmo-stp_10.42.42.5(pid=30929): stdout: | (launched: 2022-12-13_09:20:28.785988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:30.437565 run osmo-stp_10.42.42.5(pid=30929): stderr: | 20221213092028975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092028975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092028975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092028976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092028978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092028978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092028978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:30.567496 run osmo-stp_10.42.42.5(pid=30929): stdout: | (launched: 2022-12-13_09:20:28.785988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:30.691323 run osmo-stp_10.42.42.5(pid=30929): stderr: | 20221213092028975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092028975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092028975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092028976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092028978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092028978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092028978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:30.839782 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30929): Process ended prematurely: osmo-stp_10.42.42.5(pid=30929) [trial-2387↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30929)] [trial-2387↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 09:20:30.850018 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 09:20:30.878268 run osmo-hlr_10.42.42.2(pid=30926): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30926)] 09:20:30.929631 run osmo-hlr_10.42.42.2(pid=30926): stdout: | (launched: 2022-12-13_09:20:27.823832) 09:20:30.983744 run osmo-hlr_10.42.42.2(pid=30926): stderr: | 20221213092028020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092028020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092028020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092028020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092028021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092028021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092028033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092028041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092028042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092028042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:31.057366 run osmo-msc_10.42.42.6(pid=30932): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30932)] 09:20:31.108704 run osmo-msc_10.42.42.6(pid=30932): stdout: | (launched: 2022-12-13_09:20:29.942684) 09:20:31.161219 run osmo-msc_10.42.42.6(pid=30932): stderr: | 20221213092030261 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092030261 DLGLOBAL DEBUG validating counter group 0x7ff75a063c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092030261 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092030261 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092030262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092030262 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092030264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092030264 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092030264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092030264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:31.214237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30925): Terminating (SIGTERM) 09:20:31.257506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30928): Terminating (SIGTERM) 09:20:31.302112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30931): Terminating (SIGTERM) 09:20:31.347445 --- ParallelTerminationStrategy: PID 30925 died... 09:20:31.368146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30925): Terminated: ok {rc=0} 09:20:31.417079 --- ParallelTerminationStrategy: PID 30928 died... 09:20:31.437308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30928): Terminated: ok {rc=0} 09:20:31.483859 --- ParallelTerminationStrategy: PID 30931 died... 09:20:31.504019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30931): Terminated: ok {rc=0} 09:20:31.598103 bus /sierra_3: Setting Powered False 09:20:32.711177 bus /sierra_3: Setting Powered False 09:20:33.826423 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 09:20:34.911327 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:34.922519 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:20:34.973411 tst emergency_preemptive_call.py: using LAC 32987 09:20:35.089766 tst emergency_preemptive_call.py: using RAC 92 09:20:35.213810 tst emergency_preemptive_call.py: using CellId 32987 09:20:35.328827 tst emergency_preemptive_call.py: using BVCI 32988 09:20:35.433442 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:35.443893 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:35.454492 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:35.464806 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:35.475196 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:20:35.486569 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:20:35.606039 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:20:35.720812 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:20:35.838151 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:20:35.953100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:36.436467 run create_hlr_db(pid=30934): Launched 09:20:36.562765 bus /sierra_2: Setting Powered False 09:20:37.625381 run create_hlr_db(pid=30934): Terminated: ok {rc=0} 09:20:38.038888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Launched 09:20:38.328009 run osmo-hlr_10.42.42.2(pid=30937): Launched 09:20:38.438847 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:38.948397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Launched 09:20:39.238164 run osmo-stp_10.42.42.5(pid=30940): Launched 09:20:39.359184 tst emergency_preemptive_call.py: using MSISDN 8081 09:20:39.509125 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:40.030063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30942): Launched 09:20:40.318903 run osmo-msc_10.42.42.6(pid=30943): Launched 09:20:40.480149 run osmo-stp_10.42.42.5(pid=30940): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] 09:20:40.603432 run osmo-stp_10.42.42.5(pid=30940): stdout: | (launched: 2022-12-13_09:20:39.185076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:40.727132 run osmo-stp_10.42.42.5(pid=30940): stderr: | 20221213092039356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092039356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092039357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092039357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092039358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092039358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092039358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:40.848096 run osmo-stp_10.42.42.5(pid=30940): stdout: | (launched: 2022-12-13_09:20:39.185076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:40.964331 run osmo-stp_10.42.42.5(pid=30940): stderr: | 20221213092039356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092039356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092039357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092039357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092039358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092039358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092039358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:41.102775 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30940): Process ended prematurely: osmo-stp_10.42.42.5(pid=30940) [trial-2387↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] [trial-2387↪emergency:trx-lms↪emergency_preemptive_call.py:32] 09:20:41.111000 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 09:20:41.137006 run osmo-hlr_10.42.42.2(pid=30937): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30937)] 09:20:41.185283 run osmo-hlr_10.42.42.2(pid=30937): stdout: | (launched: 2022-12-13_09:20:38.275061) 09:20:41.234781 run osmo-hlr_10.42.42.2(pid=30937): stderr: | 20221213092038447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092038447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092038447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092038447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092038447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092038447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092038460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092038470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092038470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092038470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:41.303991 run osmo-msc_10.42.42.6(pid=30943): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30943)] 09:20:41.351639 run osmo-msc_10.42.42.6(pid=30943): stdout: | (launched: 2022-12-13_09:20:40.265767) 09:20:41.401137 run osmo-msc_10.42.42.6(pid=30943): stderr: | 20221213092040536 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092040536 DLGLOBAL DEBUG validating counter group 0x7fb8b5adcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092040536 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092040536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092040536 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092040537 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092040538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092040539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092040539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092040539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:41.451039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Terminating (SIGTERM) 09:20:41.490770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Terminating (SIGTERM) 09:20:41.530622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30942): Terminating (SIGTERM) 09:20:41.570817 --- ParallelTerminationStrategy: PID 30936 died... 09:20:41.590226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Terminated: ok {rc=0} 09:20:41.634228 --- ParallelTerminationStrategy: PID 30939 died... 09:20:41.652915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Terminated: ok {rc=0} 09:20:41.697259 --- ParallelTerminationStrategy: PID 30942 died... 09:20:41.715952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30942): Terminated: ok {rc=0} 09:20:41.801563 bus /sierra_9: Setting Powered False 09:20:42.901077 bus /sierra_9: Setting Powered False 09:20:44.014496 bus /sierra_8: Setting Powered False 09:20:45.112115 bus /sierra_8: Setting Powered False 09:20:46.232068 bus /sierra_3: Setting Powered False 09:20:47.329382 bus /sierra_3: Setting Powered False 09:20:48.444933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms --------------------------------------------------------------------- 09:20:49.716620 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:49.720818 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 09:20:49.752936 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 09:20:49.791448 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 09:20:49.876925 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 09:20:49.909080 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 09:20:49.946664 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 09:20:50.536258 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 09:20:50.585610 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:50.596044 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:20:50.643720 tst cs_paging_gprs_active.py: using LAC 32988 09:20:50.763077 tst cs_paging_gprs_active.py: using RAC 93 09:20:50.878307 tst cs_paging_gprs_active.py: using CellId 32988 09:20:50.993446 tst cs_paging_gprs_active.py: using BVCI 32989 09:20:51.103071 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.113763 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.124012 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.134269 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.144768 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.155857 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.166582 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.177107 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:20:51.187734 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:20:51.307311 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:20:51.426052 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:20:51.639783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:51.952732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30949): Launched 09:20:52.210339 run iperf3-srv_10.42.42.10(pid=30950): Launched 09:20:52.321825 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:20:52.519958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:52.816880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30951): Launched 09:20:53.074018 run iperf3-srv_10.42.42.10(pid=30952): Launched 09:20:53.184598 tst cs_paging_gprs_active.py:38: start network... 09:20:53.382059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:53.839854 run create_hlr_db(pid=30953): Launched 09:20:53.951789 bus /sierra_2: Setting Powered False 09:20:55.010934 run create_hlr_db(pid=30953): Terminated: ok {rc=0} 09:20:55.444763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30955): Launched 09:20:55.760576 run osmo-hlr_10.42.42.2(pid=30956): Launched 09:20:55.881122 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:56.426472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30958): Launched 09:20:56.742607 run osmo-stp_10.42.42.5(pid=30959): Launched 09:20:56.863278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:57.409279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30961): Launched 09:20:57.529746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:57.797226 run patchelf(pid=30962): Launched 09:20:57.972465 run osmo-stp_10.42.42.5(pid=30959): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30959)] 09:20:58.106605 run osmo-stp_10.42.42.5(pid=30959): stdout: | (launched: 2022-12-13_09:20:56.685445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:58.242550 run osmo-stp_10.42.42.5(pid=30959): stderr: | 20221213092056874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092056874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092056874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092056875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092056875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092056875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092056875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:58.378527 run osmo-stp_10.42.42.5(pid=30959): stdout: | (launched: 2022-12-13_09:20:56.685445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:58.508156 run osmo-stp_10.42.42.5(pid=30959): stderr: | 20221213092056874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092056874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092056874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092056875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092056875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092056875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092056875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:58.662810 run patchelf(pid=30962): Terminating (SIGINT) 09:20:58.839868 run patchelf(pid=30962): Terminated: ok {rc=0} 09:20:58.967479 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30959): Process ended prematurely: osmo-stp_10.42.42.5(pid=30959) [trial-2387↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30959)] [trial-2387↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 09:20:58.977485 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:20:59.005765 run osmo-hlr_10.42.42.2(pid=30956): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30956)] 09:20:59.055787 run osmo-hlr_10.42.42.2(pid=30956): stdout: | (launched: 2022-12-13_09:20:55.703661) 09:20:59.107889 run osmo-hlr_10.42.42.2(pid=30956): stderr: | 20221213092055901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092055901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092055901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092055901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092055901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092055901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092055914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092055923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092055924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092055924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:59.160121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30949): Terminating (SIGTERM) 09:20:59.202373 run iperf3-srv_10.42.42.10(pid=30950): Terminating (SIGTERM) 09:20:59.244701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30951): Terminating (SIGTERM) 09:20:59.286982 run iperf3-srv_10.42.42.10(pid=30952): Terminating (SIGTERM) 09:20:59.329409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30955): Terminating (SIGTERM) 09:20:59.371397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30958): Terminating (SIGTERM) 09:20:59.413688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30961): Terminating (SIGTERM) 09:20:59.455789 --- ParallelTerminationStrategy: PID 30949 died... 09:20:59.475809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30949): Terminated: ok {rc=0} 09:20:59.522273 --- ParallelTerminationStrategy: PID 30950 died... 09:20:59.541981 run iperf3-srv_10.42.42.10(pid=30950): Terminated {rc=256} 09:20:59.588535 --- ParallelTerminationStrategy: PID 30951 died... 09:20:59.608558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30951): Terminated: ok {rc=0} 09:20:59.654788 --- ParallelTerminationStrategy: PID 30952 died... 09:20:59.674313 run iperf3-srv_10.42.42.10(pid=30952): Terminated {rc=256} 09:20:59.720077 --- ParallelTerminationStrategy: PID 30955 died... 09:20:59.739625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30955): Terminated: ok {rc=0} 09:20:59.785294 --- ParallelTerminationStrategy: PID 30958 died... 09:20:59.804398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30958): Terminated: ok {rc=0} 09:20:59.850232 --- ParallelTerminationStrategy: PID 30961 died... 09:20:59.869522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30961): Terminated: ok {rc=0} 09:20:59.956696 bus /gobi_0: Setting Powered False 09:21:01.050455 bus /gobi_0: Setting Powered False 09:21:02.169810 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms iperf3.py ---------------------------------------------- 09:21:03.316637 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.328121 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:21:03.380075 tst iperf3.py: using LAC 32989 09:21:03.505512 tst iperf3.py: using RAC 94 09:21:03.631266 tst iperf3.py: using CellId 32989 09:21:03.756343 tst iperf3.py: using BVCI 32990 09:21:03.870803 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.881961 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.892691 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.903493 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.914255 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.925068 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.935849 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.946608 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:03.957863 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:21:04.073941 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:21:04.274093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:04.572271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30963): Launched 09:21:04.830677 run iperf3-srv_10.42.42.10(pid=30964): Launched 09:21:04.941939 tst iperf3.py:8: start network... 09:21:05.140706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:05.598495 run create_hlr_db(pid=30965): Launched 09:21:05.712502 bus /gobi_6: Setting Powered False 09:21:06.772010 run create_hlr_db(pid=30965): Terminated: ok {rc=0} 09:21:07.205139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30967): Launched 09:21:07.520645 run osmo-hlr_10.42.42.2(pid=30968): Launched 09:21:07.642978 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:08.191368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30970): Launched 09:21:08.507387 run osmo-stp_10.42.42.5(pid=30971): Launched 09:21:08.629398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:09.177472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30973): Launched 09:21:09.297860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:09.564876 run patchelf(pid=30974): Launched 09:21:09.740623 run osmo-stp_10.42.42.5(pid=30971): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30971)] 09:21:09.874508 run osmo-stp_10.42.42.5(pid=30971): stdout: | (launched: 2022-12-13_09:21:08.450240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:10.009898 run osmo-stp_10.42.42.5(pid=30971): stderr: | 20221213092108640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092108641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092108641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092108641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092108642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092108642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092108642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:10.145199 run osmo-stp_10.42.42.5(pid=30971): stdout: | (launched: 2022-12-13_09:21:08.450240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:10.275071 run osmo-stp_10.42.42.5(pid=30971): stderr: | 20221213092108640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092108641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092108641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092108641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092108642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092108642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092108642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:10.428628 run patchelf(pid=30974): Terminating (SIGINT) 09:21:10.606171 run patchelf(pid=30974): Terminated: ok {rc=0} 09:21:10.734428 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30971): Process ended prematurely: osmo-stp_10.42.42.5(pid=30971) [trial-2387↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30971)] [trial-2387↪gprs:trx-lms↪iperf3.py:8] 09:21:10.744333 tst iperf3.py:8: Test FAILED (7.5 sec) 09:21:10.772867 run osmo-hlr_10.42.42.2(pid=30968): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30968)] 09:21:10.823009 run osmo-hlr_10.42.42.2(pid=30968): stdout: | (launched: 2022-12-13_09:21:07.463483) 09:21:10.874941 run osmo-hlr_10.42.42.2(pid=30968): stderr: | 20221213092107659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092107659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092107659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092107659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092107660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092107660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092107671 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092107681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092107681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092107681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:10.927244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30963): Terminating (SIGTERM) 09:21:10.969344 run iperf3-srv_10.42.42.10(pid=30964): Terminating (SIGTERM) 09:21:11.011738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30967): Terminating (SIGTERM) 09:21:11.054184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30970): Terminating (SIGTERM) 09:21:11.096001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30973): Terminating (SIGTERM) 09:21:11.138596 --- ParallelTerminationStrategy: PID 30963 died... 09:21:11.158956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30963): Terminated: ok {rc=0} 09:21:11.205485 --- ParallelTerminationStrategy: PID 30964 died... 09:21:11.224747 run iperf3-srv_10.42.42.10(pid=30964): Terminated {rc=256} 09:21:11.270885 --- ParallelTerminationStrategy: PID 30967 died... 09:21:11.290482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30967): Terminated: ok {rc=0} 09:21:11.336199 --- ParallelTerminationStrategy: PID 30970 died... 09:21:11.355574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30970): Terminated: ok {rc=0} 09:21:11.401327 --- ParallelTerminationStrategy: PID 30973 died... 09:21:11.420842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30973): Terminated: ok {rc=0} 09:21:11.508292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms iperf3m4.py ---------------------------------------------- 09:21:12.655852 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:12.670702 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:21:12.718763 tst iperf3m4.py: using LAC 32990 09:21:12.842249 tst iperf3m4.py: using RAC 95 09:21:12.965905 tst iperf3m4.py: using CellId 32990 09:21:13.091084 tst iperf3m4.py: using BVCI 32991 09:21:13.206231 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.217295 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.228161 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.238905 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.249754 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.260934 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.272059 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.282994 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:13.294078 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:21:13.411751 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:21:13.533123 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:21:13.651946 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:21:13.770256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:21:13.982856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:14.298394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30975): Launched 09:21:14.572218 run iperf3-srv_10.42.42.10(pid=30976): Launched 09:21:14.690496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:21:14.903116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:15.219616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Launched 09:21:15.493209 run iperf3-srv_10.42.42.10(pid=30978): Launched 09:21:15.611773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:21:15.823928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:16.181143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30979): Launched 09:21:16.475144 run iperf3-srv_10.42.42.10(pid=30980): Launched 09:21:16.599360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:21:16.815400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:17.136006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30981): Launched 09:21:17.410126 run iperf3-srv_10.42.42.10(pid=30982): Launched 09:21:17.527985 tst iperf3m4.py:8: start network... 09:21:17.740806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:18.229191 run create_hlr_db(pid=30983): Launched 09:21:18.357992 bus /gobi_6: Setting Powered False 09:21:19.420641 run create_hlr_db(pid=30983): Terminated: ok {rc=0} 09:21:19.842719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30985): Launched 09:21:20.138082 run osmo-hlr_10.42.42.2(pid=30986): Launched 09:21:20.250993 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:20.774429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30988): Launched 09:21:21.068275 run osmo-stp_10.42.42.5(pid=30989): Launched 09:21:21.181424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:21.690855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30991): Launched 09:21:21.803651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:22.084374 run patchelf(pid=30992): Launched 09:21:22.259474 run osmo-stp_10.42.42.5(pid=30989): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30989)] 09:21:22.393192 run osmo-stp_10.42.42.5(pid=30989): stdout: | (launched: 2022-12-13_09:21:21.014557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:22.528097 run osmo-stp_10.42.42.5(pid=30989): stderr: | 20221213092121183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092121183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092121183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092121184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092121186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092121186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092121186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:22.663440 run osmo-stp_10.42.42.5(pid=30989): stdout: | (launched: 2022-12-13_09:21:21.014557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:22.792636 run osmo-stp_10.42.42.5(pid=30989): stderr: | 20221213092121183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092121183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092121183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092121184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092121186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092121186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092121186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:22.945893 run patchelf(pid=30992): Terminating (SIGINT) 09:21:23.122355 run patchelf(pid=30992): Terminated: ok {rc=0} 09:21:23.250002 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30989): Process ended prematurely: osmo-stp_10.42.42.5(pid=30989) [trial-2387↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30989)] [trial-2387↪gprs:trx-lms↪iperf3m4.py:8] 09:21:23.260056 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:21:23.288641 run osmo-hlr_10.42.42.2(pid=30986): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30986)] 09:21:23.338038 run osmo-hlr_10.42.42.2(pid=30986): stdout: | (launched: 2022-12-13_09:21:20.084017) 09:21:23.389131 run osmo-hlr_10.42.42.2(pid=30986): stderr: | 20221213092120260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092120260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092120260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092120260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092120260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092120260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092120276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092120286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092120286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092120286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:23.440225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30975): Terminating (SIGTERM) 09:21:23.481487 run iperf3-srv_10.42.42.10(pid=30976): Terminating (SIGTERM) 09:21:23.522891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Terminating (SIGTERM) 09:21:23.564574 run iperf3-srv_10.42.42.10(pid=30978): Terminating (SIGTERM) 09:21:23.606115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30979): Terminating (SIGTERM) 09:21:23.647796 run iperf3-srv_10.42.42.10(pid=30980): Terminating (SIGTERM) 09:21:23.689390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30981): Terminating (SIGTERM) 09:21:23.730806 run iperf3-srv_10.42.42.10(pid=30982): Terminating (SIGTERM) 09:21:23.771512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30985): Terminating (SIGTERM) 09:21:23.812424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30988): Terminating (SIGTERM) 09:21:23.853394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30991): Terminating (SIGTERM) 09:21:23.894411 --- ParallelTerminationStrategy: PID 30975 died... 09:21:23.914019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30975): Terminated: ok {rc=0} 09:21:23.959747 --- ParallelTerminationStrategy: PID 30976 died... 09:21:23.979234 run iperf3-srv_10.42.42.10(pid=30976): Terminated {rc=256} 09:21:24.024620 --- ParallelTerminationStrategy: PID 30977 died... 09:21:24.043913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Terminated: ok {rc=0} 09:21:24.089604 --- ParallelTerminationStrategy: PID 30978 died... 09:21:24.108922 run iperf3-srv_10.42.42.10(pid=30978): Terminated {rc=256} 09:21:24.154486 --- ParallelTerminationStrategy: PID 30979 died... 09:21:24.173797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30979): Terminated: ok {rc=0} 09:21:24.219640 --- ParallelTerminationStrategy: PID 30980 died... 09:21:24.239054 run iperf3-srv_10.42.42.10(pid=30980): Terminated {rc=256} 09:21:24.284431 --- ParallelTerminationStrategy: PID 30981 died... 09:21:24.303598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30981): Terminated: ok {rc=0} 09:21:24.349380 --- ParallelTerminationStrategy: PID 30982 died... 09:21:24.368585 run iperf3-srv_10.42.42.10(pid=30982): Terminated {rc=256} 09:21:24.414541 --- ParallelTerminationStrategy: PID 30985 died... 09:21:24.433922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30985): Terminated: ok {rc=0} 09:21:24.479240 --- ParallelTerminationStrategy: PID 30988 died... 09:21:24.498537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30988): Terminated: ok {rc=0} 09:21:24.544009 --- ParallelTerminationStrategy: PID 30991 died... 09:21:24.563768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30991): Terminated: ok {rc=0} 09:21:24.651314 bus /gobi_4: Setting Powered False 09:21:25.750345 bus /gobi_4: Setting Powered False 09:21:26.865058 bus /gobi_1: Setting Powered False 09:21:27.961961 bus /gobi_1: Setting Powered False 09:21:29.076682 bus /gobi_0: Setting Powered False 09:21:30.172407 bus /gobi_0: Setting Powered False 09:21:31.300525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms ping.py ---------------------------------------------- 09:21:32.413849 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:32.424701 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:21:32.472905 tst ping.py: using LAC 32991 09:21:32.593796 tst ping.py: using RAC 96 09:21:32.709443 tst ping.py: using CellId 32991 09:21:32.823934 tst ping.py: using BVCI 32992 09:21:32.928879 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:32.939412 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:32.949743 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:32.959902 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:32.970230 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:32.980612 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:32.991181 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:33.001720 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:21:33.116665 tst ping.py:19: start network... 09:21:33.326869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:33.809700 run create_hlr_db(pid=30994): Launched 09:21:33.936193 bus /gobi_6: Setting Powered False 09:21:34.998959 run create_hlr_db(pid=30994): Terminated: ok {rc=0} 09:21:35.415876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30996): Launched 09:21:35.706731 run osmo-hlr_10.42.42.2(pid=30997): Launched 09:21:35.817700 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:36.337699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30999): Launched 09:21:36.628497 run osmo-stp_10.42.42.5(pid=31000): Launched 09:21:36.739342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:37.241130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31002): Launched 09:21:37.352066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:37.597548 run patchelf(pid=31003): Launched 09:21:37.759445 run osmo-stp_10.42.42.5(pid=31000): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31000)] 09:21:37.883156 run osmo-stp_10.42.42.5(pid=31000): stdout: | (launched: 2022-12-13_09:21:36.575252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:38.008437 run osmo-stp_10.42.42.5(pid=31000): stderr: | 20221213092136745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092136746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092136746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092136746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092136748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092136749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092136749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:38.134109 run osmo-stp_10.42.42.5(pid=31000): stdout: | (launched: 2022-12-13_09:21:36.575252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:38.254405 run osmo-stp_10.42.42.5(pid=31000): stderr: | 20221213092136745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092136746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092136746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092136746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092136748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092136749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092136749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:38.396845 run patchelf(pid=31003): Terminating (SIGINT) 09:21:38.561136 run patchelf(pid=31003): Terminated: ok {rc=0} 09:21:38.679498 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31000): Process ended prematurely: osmo-stp_10.42.42.5(pid=31000) [trial-2387↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31000)] [trial-2387↪gprs:trx-lms↪ping.py:22] 09:21:38.688515 tst ping.py:22: Test FAILED (6.3 sec) 09:21:38.715295 run osmo-hlr_10.42.42.2(pid=30997): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30997)] 09:21:38.764297 run osmo-hlr_10.42.42.2(pid=30997): stdout: | (launched: 2022-12-13_09:21:35.653448) 09:21:38.814467 run osmo-hlr_10.42.42.2(pid=30997): stderr: | 20221213092135829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092135829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092135829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092135829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092135829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092135829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092135841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092135850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092135850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092135850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:38.864673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30996): Terminating (SIGTERM) 09:21:38.904887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30999): Terminating (SIGTERM) 09:21:38.945106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31002): Terminating (SIGTERM) 09:21:38.985479 --- ParallelTerminationStrategy: PID 30996 died... 09:21:39.005237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30996): Terminated: ok {rc=0} 09:21:39.049786 --- ParallelTerminationStrategy: PID 30999 died... 09:21:39.068745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30999): Terminated: ok {rc=0} 09:21:39.113453 --- ParallelTerminationStrategy: PID 31002 died... 09:21:39.132641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31002): Terminated: ok {rc=0} 09:21:39.219220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 09:21:40.306459 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.317649 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:21:40.367150 tst ping_idle_ping.py: using LAC 32992 09:21:40.483546 tst ping_idle_ping.py: using RAC 97 09:21:40.598704 tst ping_idle_ping.py: using CellId 32992 09:21:40.713605 tst ping_idle_ping.py: using BVCI 32993 09:21:40.821907 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.832522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.842880 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.853307 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.863485 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.874485 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.886490 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:21:40.897655 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:21:41.017202 tst ping_idle_ping.py:24: start network... 09:21:41.227605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:41.714096 run create_hlr_db(pid=31004): Launched 09:21:41.840803 bus /gobi_6: Setting Powered False 09:21:42.903349 run create_hlr_db(pid=31004): Terminated: ok {rc=0} 09:21:43.320865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Launched 09:21:43.613918 run osmo-hlr_10.42.42.2(pid=31007): Launched 09:21:43.726499 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:44.229848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Launched 09:21:44.519981 run osmo-stp_10.42.42.5(pid=31010): Launched 09:21:44.631339 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:45.134781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31012): Launched 09:21:45.245664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:45.491152 run patchelf(pid=31013): Launched 09:21:45.653221 run osmo-stp_10.42.42.5(pid=31010): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] 09:21:45.776725 run osmo-stp_10.42.42.5(pid=31010): stdout: | (launched: 2022-12-13_09:21:44.466608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:45.927908 run osmo-stp_10.42.42.5(pid=31010): stderr: | 20221213092144635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092144636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092144636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092144636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092144637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092144637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092144637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:46.056000 run osmo-stp_10.42.42.5(pid=31010): stdout: | (launched: 2022-12-13_09:21:44.466608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:46.177867 run osmo-stp_10.42.42.5(pid=31010): stderr: | 20221213092144635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092144636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092144636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092144636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092144637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092144637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092144637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:46.332478 run patchelf(pid=31013): Terminating (SIGINT) 09:21:46.503423 run patchelf(pid=31013): Terminated: ok {rc=0} 09:21:46.653571 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31010): Process ended prematurely: osmo-stp_10.42.42.5(pid=31010) [trial-2387↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] [trial-2387↪gprs:trx-lms↪ping_idle_ping.py:27] 09:21:46.667195 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:21:46.705100 run osmo-hlr_10.42.42.2(pid=31007): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31007)] 09:21:46.764476 run osmo-hlr_10.42.42.2(pid=31007): stdout: | (launched: 2022-12-13_09:21:43.560613) 09:21:46.815961 run osmo-hlr_10.42.42.2(pid=31007): stderr: | 20221213092143736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092143736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092143736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092143736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092143736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092143737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092143752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092143762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092143762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092143762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:46.868441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Terminating (SIGTERM) 09:21:46.909607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Terminating (SIGTERM) 09:21:46.951061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31012): Terminating (SIGTERM) 09:21:46.992724 --- ParallelTerminationStrategy: PID 31006 died... 09:21:47.013874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Terminated: ok {rc=0} 09:21:47.060296 --- ParallelTerminationStrategy: PID 31009 died... 09:21:47.081164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Terminated: ok {rc=0} 09:21:47.127499 --- ParallelTerminationStrategy: PID 31012 died... 09:21:47.148256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31012): Terminated: ok {rc=0} 09:21:47.235446 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 09:21:48.533255 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:48.538482 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:21:48.570642 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:21:48.609726 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:21:48.694827 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:21:48.729095 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:21:48.768523 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:21:49.364472 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:21:49.415539 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:49.426762 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:21:49.475903 tst cs_paging_gprs_active.py: using LAC 32993 09:21:49.599694 tst cs_paging_gprs_active.py: using RAC 98 09:21:49.722415 tst cs_paging_gprs_active.py: using CellId 32993 09:21:49.844853 tst cs_paging_gprs_active.py: using BVCI 32994 09:21:49.959842 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:49.971137 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:49.982134 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:49.993215 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:50.004110 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:50.015054 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:50.026212 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:50.037150 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:50.048280 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:21:50.164904 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:21:50.284232 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:21:50.499109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:50.817942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31017): Launched 09:21:51.093661 run iperf3-srv_10.42.42.10(pid=31018): Launched 09:21:51.212678 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:21:51.426710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:51.746424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31019): Launched 09:21:52.021990 run iperf3-srv_10.42.42.10(pid=31020): Launched 09:21:52.141049 tst cs_paging_gprs_active.py:38: start network... 09:21:52.354920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:52.846844 run create_hlr_db(pid=31021): Launched 09:21:52.975208 bus /gobi_6: Setting Powered False 09:21:54.038370 run create_hlr_db(pid=31021): Terminated: ok {rc=0} 09:21:54.460353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Launched 09:21:54.757705 run osmo-hlr_10.42.42.2(pid=31024): Launched 09:21:54.871354 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:55.394652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Launched 09:21:55.691510 run osmo-stp_10.42.42.5(pid=31027): Launched 09:21:55.804637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:56.315272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31029): Launched 09:21:56.428054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:56.678050 run patchelf(pid=31030): Launched 09:21:56.843916 run osmo-stp_10.42.42.5(pid=31027): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] 09:21:56.969780 run osmo-stp_10.42.42.5(pid=31027): stdout: | (launched: 2022-12-13_09:21:55.637356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:57.097320 run osmo-stp_10.42.42.5(pid=31027): stderr: | 20221213092155807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092155807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092155808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092155808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092155810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092155810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092155810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:57.225425 run osmo-stp_10.42.42.5(pid=31027): stdout: | (launched: 2022-12-13_09:21:55.637356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:57.347489 run osmo-stp_10.42.42.5(pid=31027): stderr: | 20221213092155807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092155807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092155808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092155808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092155810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092155810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092155810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:57.492161 run patchelf(pid=31030): Terminating (SIGINT) 09:21:57.659516 run patchelf(pid=31030): Terminated: ok {rc=0} 09:21:57.779853 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31027): Process ended prematurely: osmo-stp_10.42.42.5(pid=31027) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:21:57.789430 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:21:57.816362 run osmo-hlr_10.42.42.2(pid=31024): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31024)] 09:21:57.864294 run osmo-hlr_10.42.42.2(pid=31024): stdout: | (launched: 2022-12-13_09:21:54.704116) 09:21:57.913872 run osmo-hlr_10.42.42.2(pid=31024): stderr: | 20221213092154879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092154879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092154879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092154879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092154879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092154879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092154892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092154900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092154901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092154901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:57.963792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31017): Terminating (SIGTERM) 09:21:58.003811 run iperf3-srv_10.42.42.10(pid=31018): Terminating (SIGTERM) 09:21:58.043812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31019): Terminating (SIGTERM) 09:21:58.083900 run iperf3-srv_10.42.42.10(pid=31020): Terminating (SIGTERM) 09:21:58.123702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Terminating (SIGTERM) 09:21:58.163718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Terminating (SIGTERM) 09:21:58.203732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31029): Terminating (SIGTERM) 09:21:58.244150 --- ParallelTerminationStrategy: PID 31017 died... 09:21:58.263636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31017): Terminated: ok {rc=0} 09:21:58.307953 --- ParallelTerminationStrategy: PID 31018 died... 09:21:58.326936 run iperf3-srv_10.42.42.10(pid=31018): Terminated {rc=256} 09:21:58.370804 --- ParallelTerminationStrategy: PID 31019 died... 09:21:58.389860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31019): Terminated: ok {rc=0} 09:21:58.433799 --- ParallelTerminationStrategy: PID 31020 died... 09:21:58.452706 run iperf3-srv_10.42.42.10(pid=31020): Terminated {rc=256} 09:21:58.496478 --- ParallelTerminationStrategy: PID 31023 died... 09:21:58.515232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Terminated: ok {rc=0} 09:21:58.559016 --- ParallelTerminationStrategy: PID 31026 died... 09:21:58.577933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Terminated: ok {rc=0} 09:21:58.621834 --- ParallelTerminationStrategy: PID 31029 died... 09:21:58.640514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31029): Terminated: ok {rc=0} 09:21:58.726576 bus /gobi_0: Setting Powered False 09:21:59.825296 bus /gobi_0: Setting Powered False 09:22:00.951702 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:22:02.123697 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.135126 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:22:02.186851 tst iperf3.py: using LAC 32994 09:22:02.314625 tst iperf3.py: using RAC 99 09:22:02.432074 tst iperf3.py: using CellId 32994 09:22:02.550329 tst iperf3.py: using BVCI 32995 09:22:02.667690 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.679285 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.690533 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.701908 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.713402 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.724744 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.736419 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.747880 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:02.759467 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:02.874348 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:22:03.073433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:03.370730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31031): Launched 09:22:03.629011 run iperf3-srv_10.42.42.10(pid=31032): Launched 09:22:03.740664 tst iperf3.py:8: start network... 09:22:03.938940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:04.396503 run create_hlr_db(pid=31033): Launched 09:22:04.525619 bus /gobi_6: Setting Powered False 09:22:05.589078 run create_hlr_db(pid=31033): Terminated: ok {rc=0} 09:22:06.029775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31035): Launched 09:22:06.345498 run osmo-hlr_10.42.42.2(pid=31036): Launched 09:22:06.466308 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:07.012397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31038): Launched 09:22:07.328387 run osmo-stp_10.42.42.5(pid=31039): Launched 09:22:07.449482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:07.997563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31041): Launched 09:22:08.118268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:08.385644 run patchelf(pid=31042): Launched 09:22:08.561185 run osmo-stp_10.42.42.5(pid=31039): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31039)] 09:22:08.695486 run osmo-stp_10.42.42.5(pid=31039): stdout: | (launched: 2022-12-13_09:22:07.271453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:08.830554 run osmo-stp_10.42.42.5(pid=31039): stderr: | 20221213092207463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092207464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092207464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092207464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092207465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092207465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092207465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:08.966096 run osmo-stp_10.42.42.5(pid=31039): stdout: | (launched: 2022-12-13_09:22:07.271453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:09.096136 run osmo-stp_10.42.42.5(pid=31039): stderr: | 20221213092207463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092207464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092207464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092207464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092207465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092207465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092207465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:09.250441 run patchelf(pid=31042): Terminating (SIGINT) 09:22:09.427772 run patchelf(pid=31042): Terminated: ok {rc=0} 09:22:09.555895 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31039): Process ended prematurely: osmo-stp_10.42.42.5(pid=31039) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31039)] [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 09:22:09.565928 tst iperf3.py:8: Test FAILED (7.5 sec) 09:22:09.594231 run osmo-hlr_10.42.42.2(pid=31036): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31036)] 09:22:09.644011 run osmo-hlr_10.42.42.2(pid=31036): stdout: | (launched: 2022-12-13_09:22:06.287852) 09:22:09.695426 run osmo-hlr_10.42.42.2(pid=31036): stderr: | 20221213092206486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092206486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092206487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092206487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092206487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092206487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092206500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092206508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092206508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092206508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:09.747238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31031): Terminating (SIGTERM) 09:22:09.788676 run iperf3-srv_10.42.42.10(pid=31032): Terminating (SIGTERM) 09:22:09.829812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31035): Terminating (SIGTERM) 09:22:09.871262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31038): Terminating (SIGTERM) 09:22:09.912680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31041): Terminating (SIGTERM) 09:22:09.954281 --- ParallelTerminationStrategy: PID 31031 died... 09:22:09.974477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31031): Terminated: ok {rc=0} 09:22:10.020656 --- ParallelTerminationStrategy: PID 31032 died... 09:22:10.040274 run iperf3-srv_10.42.42.10(pid=31032): Terminated {rc=256} 09:22:10.086099 --- ParallelTerminationStrategy: PID 31035 died... 09:22:10.105625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31035): Terminated: ok {rc=0} 09:22:10.151312 --- ParallelTerminationStrategy: PID 31038 died... 09:22:10.170755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31038): Terminated: ok {rc=0} 09:22:10.216223 --- ParallelTerminationStrategy: PID 31041 died... 09:22:10.235827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31041): Terminated: ok {rc=0} 09:22:10.323422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:22:11.471264 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:11.483168 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:22:11.550843 tst iperf3m4.py: using LAC 32995 09:22:11.677823 tst iperf3m4.py: using RAC 100 09:22:11.802126 tst iperf3m4.py: using CellId 32995 09:22:11.928368 tst iperf3m4.py: using BVCI 32996 09:22:12.043737 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.055059 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.066139 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.077153 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.088035 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.099053 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.110288 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.121132 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:12.132167 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:12.249863 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:12.368346 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:12.486995 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:12.602946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:22:12.803031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:13.100482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31043): Launched 09:22:13.358107 run iperf3-srv_10.42.42.10(pid=31044): Launched 09:22:13.469676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:22:13.669519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:13.967179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31045): Launched 09:22:14.224356 run iperf3-srv_10.42.42.10(pid=31046): Launched 09:22:14.335562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:22:14.534163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:14.831235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31047): Launched 09:22:15.087978 run iperf3-srv_10.42.42.10(pid=31048): Launched 09:22:15.198933 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:22:15.397327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:15.694408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31049): Launched 09:22:15.972381 run iperf3-srv_10.42.42.10(pid=31050): Launched 09:22:16.100292 tst iperf3m4.py:8: start network... 09:22:16.302575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:16.775950 run create_hlr_db(pid=31051): Launched 09:22:16.930533 bus /gobi_6: Setting Powered False 09:22:17.989631 run create_hlr_db(pid=31051): Terminated: ok {rc=0} 09:22:18.403452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31053): Launched 09:22:18.699253 run osmo-hlr_10.42.42.2(pid=31054): Launched 09:22:18.812149 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:19.326685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31056): Launched 09:22:19.622182 run osmo-stp_10.42.42.5(pid=31057): Launched 09:22:19.735610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:20.245720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31059): Launched 09:22:20.358892 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:20.608584 run patchelf(pid=31060): Launched 09:22:20.773582 run osmo-stp_10.42.42.5(pid=31057): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31057)] 09:22:20.899548 run osmo-stp_10.42.42.5(pid=31057): stdout: | (launched: 2022-12-13_09:22:19.567825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:21.027061 run osmo-stp_10.42.42.5(pid=31057): stderr: | 20221213092219738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092219739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092219739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092219739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092219740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092219740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092219740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:21.154684 run osmo-stp_10.42.42.5(pid=31057): stdout: | (launched: 2022-12-13_09:22:19.567825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:21.276793 run osmo-stp_10.42.42.5(pid=31057): stderr: | 20221213092219738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092219739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092219739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092219739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092219740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092219740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092219740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:21.421355 run patchelf(pid=31060): Terminating (SIGINT) 09:22:21.587866 run patchelf(pid=31060): Terminated: ok {rc=0} 09:22:21.708795 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31057): Process ended prematurely: osmo-stp_10.42.42.5(pid=31057) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31057)] [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 09:22:21.718634 tst iperf3m4.py:8: Test FAILED (10.3 sec) 09:22:21.746356 run osmo-hlr_10.42.42.2(pid=31054): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31054)] 09:22:21.795360 run osmo-hlr_10.42.42.2(pid=31054): stdout: | (launched: 2022-12-13_09:22:18.645208) 09:22:21.845529 run osmo-hlr_10.42.42.2(pid=31054): stderr: | 20221213092218819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092218819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092218820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092218820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092218820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092218820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092218832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092218840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092218840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092218841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:21.895833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31043): Terminating (SIGTERM) 09:22:21.936297 run iperf3-srv_10.42.42.10(pid=31044): Terminating (SIGTERM) 09:22:21.976467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31045): Terminating (SIGTERM) 09:22:22.016911 run iperf3-srv_10.42.42.10(pid=31046): Terminating (SIGTERM) 09:22:22.057322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31047): Terminating (SIGTERM) 09:22:22.097603 run iperf3-srv_10.42.42.10(pid=31048): Terminating (SIGTERM) 09:22:22.137757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31049): Terminating (SIGTERM) 09:22:22.178123 run iperf3-srv_10.42.42.10(pid=31050): Terminating (SIGTERM) 09:22:22.218258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31053): Terminating (SIGTERM) 09:22:22.258443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31056): Terminating (SIGTERM) 09:22:22.298709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31059): Terminating (SIGTERM) 09:22:22.339177 --- ParallelTerminationStrategy: PID 31043 died... 09:22:22.358614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31043): Terminated: ok {rc=0} 09:22:22.402740 --- ParallelTerminationStrategy: PID 31044 died... 09:22:22.421692 run iperf3-srv_10.42.42.10(pid=31044): Terminated {rc=256} 09:22:22.465634 --- ParallelTerminationStrategy: PID 31045 died... 09:22:22.484456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31045): Terminated: ok {rc=0} 09:22:22.528539 --- ParallelTerminationStrategy: PID 31046 died... 09:22:22.547388 run iperf3-srv_10.42.42.10(pid=31046): Terminated {rc=256} 09:22:22.592004 --- ParallelTerminationStrategy: PID 31047 died... 09:22:22.610863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31047): Terminated: ok {rc=0} 09:22:22.654883 --- ParallelTerminationStrategy: PID 31048 died... 09:22:22.673747 run iperf3-srv_10.42.42.10(pid=31048): Terminated {rc=256} 09:22:22.717446 --- ParallelTerminationStrategy: PID 31049 died... 09:22:22.736221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31049): Terminated: ok {rc=0} 09:22:22.780006 --- ParallelTerminationStrategy: PID 31050 died... 09:22:22.798892 run iperf3-srv_10.42.42.10(pid=31050): Terminated {rc=256} 09:22:22.842819 --- ParallelTerminationStrategy: PID 31053 died... 09:22:22.861779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31053): Terminated: ok {rc=0} 09:22:22.905798 --- ParallelTerminationStrategy: PID 31056 died... 09:22:22.924622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31056): Terminated: ok {rc=0} 09:22:22.968716 --- ParallelTerminationStrategy: PID 31059 died... 09:22:22.987607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31059): Terminated: ok {rc=0} 09:22:23.070753 bus /gobi_4: Setting Powered False 09:22:24.165697 bus /gobi_4: Setting Powered False 09:22:25.279791 bus /gobi_1: Setting Powered False 09:22:26.378029 bus /gobi_1: Setting Powered False 09:22:27.492390 bus /gobi_0: Setting Powered False 09:22:28.589854 bus /gobi_0: Setting Powered False 09:22:29.704734 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 09:22:30.808614 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:30.820475 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:22:30.895844 tst ping.py: using LAC 32996 09:22:31.021744 tst ping.py: using RAC 101 09:22:31.145989 tst ping.py: using CellId 32996 09:22:31.295831 tst ping.py: using BVCI 32997 09:22:31.407315 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:31.419428 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:31.431374 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:31.443204 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:31.455748 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:31.468141 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:31.481901 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:31.494771 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:31.642723 tst ping.py:19: start network... 09:22:31.886781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:32.345472 run create_hlr_db(pid=31061): Launched 09:22:32.455817 bus /gobi_6: Setting Powered False 09:22:33.513928 run create_hlr_db(pid=31061): Terminated: ok {rc=0} 09:22:33.939970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Launched 09:22:34.250635 run osmo-hlr_10.42.42.2(pid=31064): Launched 09:22:34.369190 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:34.910759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Launched 09:22:35.220139 run osmo-stp_10.42.42.5(pid=31067): Launched 09:22:35.338326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:35.874284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31069): Launched 09:22:35.992549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:36.254343 run patchelf(pid=31070): Launched 09:22:36.426601 run osmo-stp_10.42.42.5(pid=31067): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] 09:22:36.558538 run osmo-stp_10.42.42.5(pid=31067): stdout: | (launched: 2022-12-13_09:22:35.163870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:36.691839 run osmo-stp_10.42.42.5(pid=31067): stderr: | 20221213092235354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092235354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092235355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092235355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092235356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092235356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092235356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:36.825064 run osmo-stp_10.42.42.5(pid=31067): stdout: | (launched: 2022-12-13_09:22:35.163870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:36.952345 run osmo-stp_10.42.42.5(pid=31067): stderr: | 20221213092235354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092235354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092235355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092235355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092235356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092235356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092235356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:37.103456 run patchelf(pid=31070): Terminating (SIGINT) 09:22:37.276913 run patchelf(pid=31070): Terminated: ok {rc=0} 09:22:37.402234 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31067): Process ended prematurely: osmo-stp_10.42.42.5(pid=31067) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 09:22:37.411661 tst ping.py:22: Test FAILED (6.6 sec) 09:22:37.439415 run osmo-hlr_10.42.42.2(pid=31064): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31064)] 09:22:37.489088 run osmo-hlr_10.42.42.2(pid=31064): stdout: | (launched: 2022-12-13_09:22:34.194415) 09:22:37.540332 run osmo-hlr_10.42.42.2(pid=31064): stderr: | 20221213092234392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092234392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092234392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092234392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092234392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092234392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092234404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092234413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092234413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092234413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:37.592102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Terminating (SIGTERM) 09:22:37.633697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Terminating (SIGTERM) 09:22:37.675059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31069): Terminating (SIGTERM) 09:22:37.716675 --- ParallelTerminationStrategy: PID 31063 died... 09:22:37.736549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Terminated: ok {rc=0} 09:22:37.782027 --- ParallelTerminationStrategy: PID 31066 died... 09:22:37.801356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Terminated: ok {rc=0} 09:22:37.846956 --- ParallelTerminationStrategy: PID 31069 died... 09:22:37.866630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31069): Terminated: ok {rc=0} 09:22:37.953493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:22:39.039654 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.051355 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:22:39.104409 tst ping_idle_ping.py: using LAC 32997 09:22:39.228198 tst ping_idle_ping.py: using RAC 102 09:22:39.350519 tst ping_idle_ping.py: using CellId 32997 09:22:39.474300 tst ping_idle_ping.py: using BVCI 32998 09:22:39.589246 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.600532 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.612010 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.623685 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.634858 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.646128 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.657624 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:39.668693 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:39.783928 tst ping_idle_ping.py:24: start network... 09:22:39.978864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:40.431018 run create_hlr_db(pid=31071): Launched 09:22:40.542674 bus /gobi_6: Setting Powered False 09:22:41.601447 run create_hlr_db(pid=31071): Terminated: ok {rc=0} 09:22:42.028167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31073): Launched 09:22:42.339287 run osmo-hlr_10.42.42.2(pid=31074): Launched 09:22:42.457936 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:42.998467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31076): Launched 09:22:43.309403 run osmo-stp_10.42.42.5(pid=31077): Launched 09:22:43.429145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:43.968528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31079): Launched 09:22:44.087619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:44.350052 run patchelf(pid=31080): Launched 09:22:44.522953 run osmo-stp_10.42.42.5(pid=31077): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31077)] 09:22:44.655213 run osmo-stp_10.42.42.5(pid=31077): stdout: | (launched: 2022-12-13_09:22:43.252568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:44.788682 run osmo-stp_10.42.42.5(pid=31077): stderr: | 20221213092243444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092243444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092243444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092243444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092243445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092243445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092243445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:44.923420 run osmo-stp_10.42.42.5(pid=31077): stdout: | (launched: 2022-12-13_09:22:43.252568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:45.051359 run osmo-stp_10.42.42.5(pid=31077): stderr: | 20221213092243444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092243444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092243444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092243444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092243445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092243445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092243445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:45.203114 run patchelf(pid=31080): Terminating (SIGINT) 09:22:45.377333 run patchelf(pid=31080): Terminated: ok {rc=0} 09:22:45.503189 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31077): Process ended prematurely: osmo-stp_10.42.42.5(pid=31077) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31077)] [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 09:22:45.512474 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:22:45.540155 run osmo-hlr_10.42.42.2(pid=31074): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31074)] 09:22:45.589889 run osmo-hlr_10.42.42.2(pid=31074): stdout: | (launched: 2022-12-13_09:22:42.283153) 09:22:45.641611 run osmo-hlr_10.42.42.2(pid=31074): stderr: | 20221213092242477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092242477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092242477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092242477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092242477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092242477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092242491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092242499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092242500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092242500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:45.693640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31073): Terminating (SIGTERM) 09:22:45.734865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31076): Terminating (SIGTERM) 09:22:45.776377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31079): Terminating (SIGTERM) 09:22:45.818581 --- ParallelTerminationStrategy: PID 31073 died... 09:22:45.848406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31073): Terminated: ok {rc=0} 09:22:45.913171 --- ParallelTerminationStrategy: PID 31076 died... 09:22:45.933433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31076): Terminated: ok {rc=0} 09:22:45.980312 --- ParallelTerminationStrategy: PID 31079 died... 09:22:46.000287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31079): Terminated: ok {rc=0} 09:22:46.100133 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:22:47.410449 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:22:47.416852 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:22:47.449812 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:22:47.490432 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:22:47.575261 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:22:47.608059 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:22:47.647057 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:22:48.240044 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:22:48.289583 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.300372 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:22:48.373859 tst cs_paging_gprs_active.py: using LAC 32998 09:22:48.494443 tst cs_paging_gprs_active.py: using RAC 103 09:22:48.620727 tst cs_paging_gprs_active.py: using CellId 32998 09:22:48.744495 tst cs_paging_gprs_active.py: using BVCI 32999 09:22:48.859762 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.871173 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.882294 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.893403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.904385 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.915599 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.926831 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.937857 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:48.949030 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:22:49.068016 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:22:49.184009 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:22:49.399392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:49.719062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31089): Launched 09:22:49.993877 run iperf3-srv_10.42.42.10(pid=31090): Launched 09:22:50.112043 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:22:50.324552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:50.641990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31091): Launched 09:22:50.916674 run iperf3-srv_10.42.42.10(pid=31092): Launched 09:22:51.034427 tst cs_paging_gprs_active.py:38: start network... 09:22:51.237621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:51.696239 run create_hlr_db(pid=31093): Launched 09:22:51.810479 bus /gobi_6: Setting Powered False 09:22:52.870293 run create_hlr_db(pid=31093): Terminated: ok {rc=0} 09:22:53.283209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31095): Launched 09:22:53.578850 run osmo-hlr_10.42.42.2(pid=31096): Launched 09:22:53.691873 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:54.213632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31098): Launched 09:22:54.509235 run osmo-stp_10.42.42.5(pid=31099): Launched 09:22:54.622913 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:55.133474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31101): Launched 09:22:55.247211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:55.503159 run patchelf(pid=31102): Launched 09:22:55.668487 run osmo-stp_10.42.42.5(pid=31099): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31099)] 09:22:55.794384 run osmo-stp_10.42.42.5(pid=31099): stdout: | (launched: 2022-12-13_09:22:54.455403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:55.921915 run osmo-stp_10.42.42.5(pid=31099): stderr: | 20221213092254626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092254626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092254626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092254627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092254627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092254627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092254627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:56.049802 run osmo-stp_10.42.42.5(pid=31099): stdout: | (launched: 2022-12-13_09:22:54.455403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:56.172014 run osmo-stp_10.42.42.5(pid=31099): stderr: | 20221213092254626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092254626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092254626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092254627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092254627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092254627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092254627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:56.316444 run patchelf(pid=31102): Terminating (SIGINT) 09:22:56.487551 run patchelf(pid=31102): Terminated: ok {rc=0} 09:22:56.616666 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31099): Process ended prematurely: osmo-stp_10.42.42.5(pid=31099) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31099)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:22:56.627066 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:22:56.655741 run osmo-hlr_10.42.42.2(pid=31096): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31096)] 09:22:56.705532 run osmo-hlr_10.42.42.2(pid=31096): stdout: | (launched: 2022-12-13_09:22:53.524693) 09:22:56.757135 run osmo-hlr_10.42.42.2(pid=31096): stderr: | 20221213092253702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092253702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092253702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092253702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092253702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092253702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092253715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092253723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092253723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092253723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:56.808870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31089): Terminating (SIGTERM) 09:22:56.850155 run iperf3-srv_10.42.42.10(pid=31090): Terminating (SIGTERM) 09:22:56.891408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31091): Terminating (SIGTERM) 09:22:56.933540 run iperf3-srv_10.42.42.10(pid=31092): Terminating (SIGTERM) 09:22:56.974844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31095): Terminating (SIGTERM) 09:22:57.016648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31098): Terminating (SIGTERM) 09:22:57.058496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31101): Terminating (SIGTERM) 09:22:57.100131 --- ParallelTerminationStrategy: PID 31089 died... 09:22:57.120414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31089): Terminated: ok {rc=0} 09:22:57.166201 --- ParallelTerminationStrategy: PID 31090 died... 09:22:57.185485 run iperf3-srv_10.42.42.10(pid=31090): Terminated {rc=256} 09:22:57.231046 --- ParallelTerminationStrategy: PID 31091 died... 09:22:57.250410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31091): Terminated: ok {rc=0} 09:22:57.296083 --- ParallelTerminationStrategy: PID 31092 died... 09:22:57.315475 run iperf3-srv_10.42.42.10(pid=31092): Terminated {rc=256} 09:22:57.360832 --- ParallelTerminationStrategy: PID 31095 died... 09:22:57.380646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31095): Terminated: ok {rc=0} 09:22:57.426233 --- ParallelTerminationStrategy: PID 31098 died... 09:22:57.445608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31098): Terminated: ok {rc=0} 09:22:57.491141 --- ParallelTerminationStrategy: PID 31101 died... 09:22:57.510558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31101): Terminated: ok {rc=0} 09:22:57.598002 bus /gobi_0: Setting Powered False 09:22:58.695735 bus /gobi_0: Setting Powered False 09:22:59.810260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:23:00.965954 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:00.978606 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:23:01.051349 tst iperf3.py: using LAC 32999 09:23:01.178704 tst iperf3.py: using RAC 104 09:23:01.325816 tst iperf3.py: using CellId 32999 09:23:01.445866 tst iperf3.py: using BVCI 33000 09:23:01.563794 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.575319 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.586808 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.598939 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.611046 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.624489 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.636644 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.648662 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:01.660520 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:01.800307 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:23:02.017821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:02.331728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31103): Launched 09:23:02.589879 run iperf3-srv_10.42.42.10(pid=31104): Launched 09:23:02.701317 tst iperf3.py:8: start network... 09:23:02.900672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:03.357881 run create_hlr_db(pid=31105): Launched 09:23:03.472024 bus /gobi_6: Setting Powered False 09:23:04.530549 run create_hlr_db(pid=31105): Terminated: ok {rc=0} 09:23:04.942841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31107): Launched 09:23:05.238095 run osmo-hlr_10.42.42.2(pid=31108): Launched 09:23:05.350621 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:05.871108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31110): Launched 09:23:06.166854 run osmo-stp_10.42.42.5(pid=31111): Launched 09:23:06.279842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:06.788923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31113): Launched 09:23:06.910060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:07.175909 run patchelf(pid=31114): Launched 09:23:07.351013 run osmo-stp_10.42.42.5(pid=31111): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31111)] 09:23:07.484441 run osmo-stp_10.42.42.5(pid=31111): stdout: | (launched: 2022-12-13_09:23:06.112629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:07.619973 run osmo-stp_10.42.42.5(pid=31111): stderr: | 20221213092306282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092306282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092306282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092306282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092306283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092306283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092306283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:07.755103 run osmo-stp_10.42.42.5(pid=31111): stdout: | (launched: 2022-12-13_09:23:06.112629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:07.884509 run osmo-stp_10.42.42.5(pid=31111): stderr: | 20221213092306282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092306282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092306282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092306282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092306283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092306283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092306283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:08.037923 run patchelf(pid=31114): Terminating (SIGINT) 09:23:08.215075 run patchelf(pid=31114): Terminated: ok {rc=0} 09:23:08.342354 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31111): Process ended prematurely: osmo-stp_10.42.42.5(pid=31111) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31111)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 09:23:08.352295 tst iperf3.py:8: Test FAILED (7.4 sec) 09:23:08.380531 run osmo-hlr_10.42.42.2(pid=31108): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31108)] 09:23:08.429944 run osmo-hlr_10.42.42.2(pid=31108): stdout: | (launched: 2022-12-13_09:23:05.184300) 09:23:08.481238 run osmo-hlr_10.42.42.2(pid=31108): stderr: | 20221213092305360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092305360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092305360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092305360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092305360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092305360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092305373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092305381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092305382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092305382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:08.532864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31103): Terminating (SIGTERM) 09:23:08.574045 run iperf3-srv_10.42.42.10(pid=31104): Terminating (SIGTERM) 09:23:08.615962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31107): Terminating (SIGTERM) 09:23:08.657383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31110): Terminating (SIGTERM) 09:23:08.698658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31113): Terminating (SIGTERM) 09:23:08.740548 --- ParallelTerminationStrategy: PID 31103 died... 09:23:08.760442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31103): Terminated: ok {rc=0} 09:23:08.806244 --- ParallelTerminationStrategy: PID 31104 died... 09:23:08.825658 run iperf3-srv_10.42.42.10(pid=31104): Terminated {rc=256} 09:23:08.871057 --- ParallelTerminationStrategy: PID 31107 died... 09:23:08.890460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31107): Terminated: ok {rc=0} 09:23:08.935804 --- ParallelTerminationStrategy: PID 31110 died... 09:23:08.955115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31110): Terminated: ok {rc=0} 09:23:09.000669 --- ParallelTerminationStrategy: PID 31113 died... 09:23:09.020192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31113): Terminated: ok {rc=0} 09:23:09.106698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:23:10.255094 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.266888 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:23:10.342450 tst iperf3m4.py: using LAC 33000 09:23:10.462496 tst iperf3m4.py: using RAC 105 09:23:10.576919 tst iperf3m4.py: using CellId 33000 09:23:10.691928 tst iperf3m4.py: using BVCI 33001 09:23:10.799167 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.810220 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.820925 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.831784 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.842848 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.853705 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.864616 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.875469 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:10.886535 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:11.002256 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:11.124937 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:11.245393 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:11.364423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:23:11.578124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:11.896144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31115): Launched 09:23:12.171134 run iperf3-srv_10.42.42.10(pid=31116): Launched 09:23:12.290144 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:23:12.503561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:12.821156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31117): Launched 09:23:13.096608 run iperf3-srv_10.42.42.10(pid=31118): Launched 09:23:13.215955 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:23:13.428893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:13.746140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31119): Launched 09:23:14.019395 run iperf3-srv_10.42.42.10(pid=31120): Launched 09:23:14.137696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:23:14.350334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:14.667865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31121): Launched 09:23:14.942317 run iperf3-srv_10.42.42.10(pid=31122): Launched 09:23:15.060702 tst iperf3m4.py:8: start network... 09:23:15.273818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:15.764737 run create_hlr_db(pid=31123): Launched 09:23:15.921902 bus /gobi_6: Setting Powered False 09:23:16.984715 run create_hlr_db(pid=31123): Terminated: ok {rc=0} 09:23:17.431082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31125): Launched 09:23:17.747857 run osmo-hlr_10.42.42.2(pid=31126): Launched 09:23:17.868477 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:18.412120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31128): Launched 09:23:18.727641 run osmo-stp_10.42.42.5(pid=31129): Launched 09:23:18.847793 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:19.392378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31131): Launched 09:23:19.512616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:19.778691 run patchelf(pid=31132): Launched 09:23:19.952854 run osmo-stp_10.42.42.5(pid=31129): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31129)] 09:23:20.086145 run osmo-stp_10.42.42.5(pid=31129): stdout: | (launched: 2022-12-13_09:23:18.670257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:20.221451 run osmo-stp_10.42.42.5(pid=31129): stderr: | 20221213092318861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092318861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092318861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092318862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092318864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092318864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092318864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:20.356103 run osmo-stp_10.42.42.5(pid=31129): stdout: | (launched: 2022-12-13_09:23:18.670257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:20.485483 run osmo-stp_10.42.42.5(pid=31129): stderr: | 20221213092318861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092318861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092318861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092318862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092318864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092318864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092318864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:20.638754 run patchelf(pid=31132): Terminating (SIGINT) 09:23:20.815056 run patchelf(pid=31132): Terminated: ok {rc=0} 09:23:20.942189 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31129): Process ended prematurely: osmo-stp_10.42.42.5(pid=31129) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31129)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:23:20.952233 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:23:20.980641 run osmo-hlr_10.42.42.2(pid=31126): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31126)] 09:23:21.029982 run osmo-hlr_10.42.42.2(pid=31126): stdout: | (launched: 2022-12-13_09:23:17.690069) 09:23:21.081129 run osmo-hlr_10.42.42.2(pid=31126): stderr: | 20221213092317890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092317890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092317891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092317891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092317891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092317891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092317904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092317914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092317914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092317914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:21.132763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31115): Terminating (SIGTERM) 09:23:21.174324 run iperf3-srv_10.42.42.10(pid=31116): Terminating (SIGTERM) 09:23:21.215711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31117): Terminating (SIGTERM) 09:23:21.257077 run iperf3-srv_10.42.42.10(pid=31118): Terminating (SIGTERM) 09:23:21.298280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31119): Terminating (SIGTERM) 09:23:21.339478 run iperf3-srv_10.42.42.10(pid=31120): Terminating (SIGTERM) 09:23:21.380440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31121): Terminating (SIGTERM) 09:23:21.421567 run iperf3-srv_10.42.42.10(pid=31122): Terminating (SIGTERM) 09:23:21.462550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31125): Terminating (SIGTERM) 09:23:21.503545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31128): Terminating (SIGTERM) 09:23:21.544365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31131): Terminating (SIGTERM) 09:23:21.585579 --- ParallelTerminationStrategy: PID 31115 died... 09:23:21.605292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31115): Terminated: ok {rc=0} 09:23:21.651314 --- ParallelTerminationStrategy: PID 31116 died... 09:23:21.670964 run iperf3-srv_10.42.42.10(pid=31116): Terminated {rc=256} 09:23:21.716570 --- ParallelTerminationStrategy: PID 31117 died... 09:23:21.736076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31117): Terminated: ok {rc=0} 09:23:21.781625 --- ParallelTerminationStrategy: PID 31118 died... 09:23:21.801084 run iperf3-srv_10.42.42.10(pid=31118): Terminated {rc=256} 09:23:21.846773 --- ParallelTerminationStrategy: PID 31119 died... 09:23:21.866298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31119): Terminated: ok {rc=0} 09:23:21.912510 --- ParallelTerminationStrategy: PID 31120 died... 09:23:21.931990 run iperf3-srv_10.42.42.10(pid=31120): Terminated {rc=256} 09:23:21.978260 --- ParallelTerminationStrategy: PID 31121 died... 09:23:21.997743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31121): Terminated: ok {rc=0} 09:23:22.043435 --- ParallelTerminationStrategy: PID 31122 died... 09:23:22.062958 run iperf3-srv_10.42.42.10(pid=31122): Terminated {rc=256} 09:23:22.108625 --- ParallelTerminationStrategy: PID 31125 died... 09:23:22.128163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31125): Terminated: ok {rc=0} 09:23:22.174108 --- ParallelTerminationStrategy: PID 31128 died... 09:23:22.193845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31128): Terminated: ok {rc=0} 09:23:22.239788 --- ParallelTerminationStrategy: PID 31131 died... 09:23:22.259297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31131): Terminated: ok {rc=0} 09:23:22.346936 bus /gobi_4: Setting Powered False 09:23:23.444567 bus /gobi_4: Setting Powered False 09:23:24.560583 bus /gobi_1: Setting Powered False 09:23:25.658959 bus /gobi_1: Setting Powered False 09:23:26.773913 bus /gobi_0: Setting Powered False 09:23:27.872558 bus /gobi_0: Setting Powered False 09:23:28.991042 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:23:30.093743 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.105633 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:23:30.177430 tst ping.py: using LAC 33001 09:23:30.299738 tst ping.py: using RAC 106 09:23:30.423604 tst ping.py: using CellId 33001 09:23:30.544794 tst ping.py: using BVCI 33002 09:23:30.657709 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.669083 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.680172 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.691229 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.702259 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.713355 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.724407 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:30.735448 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:30.859732 tst ping.py:19: start network... 09:23:31.081566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:31.576542 run create_hlr_db(pid=31134): Launched 09:23:31.731885 bus /gobi_6: Setting Powered False 09:23:32.794346 run create_hlr_db(pid=31134): Terminated: ok {rc=0} 09:23:33.214279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31136): Launched 09:23:33.505404 run osmo-hlr_10.42.42.2(pid=31137): Launched 09:23:33.617289 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:34.133488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31139): Launched 09:23:34.424201 run osmo-stp_10.42.42.5(pid=31140): Launched 09:23:34.534839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:35.037409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31142): Launched 09:23:35.148923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:35.394062 run patchelf(pid=31143): Launched 09:23:35.556180 run osmo-stp_10.42.42.5(pid=31140): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31140)] 09:23:35.679902 run osmo-stp_10.42.42.5(pid=31140): stdout: | (launched: 2022-12-13_09:23:34.370714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:35.805186 run osmo-stp_10.42.42.5(pid=31140): stderr: | 20221213092334537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092334538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092334538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092334538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092334541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092334541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092334541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:35.930558 run osmo-stp_10.42.42.5(pid=31140): stdout: | (launched: 2022-12-13_09:23:34.370714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:36.050504 run osmo-stp_10.42.42.5(pid=31140): stderr: | 20221213092334537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092334538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092334538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092334538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092334541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092334541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092334541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:36.192280 run patchelf(pid=31143): Terminating (SIGINT) 09:23:36.356649 run patchelf(pid=31143): Terminated: ok {rc=0} 09:23:36.475358 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31140): Process ended prematurely: osmo-stp_10.42.42.5(pid=31140) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31140)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 09:23:36.484223 tst ping.py:22: Test FAILED (6.4 sec) 09:23:36.510851 run osmo-hlr_10.42.42.2(pid=31137): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31137)] 09:23:36.559473 run osmo-hlr_10.42.42.2(pid=31137): stdout: | (launched: 2022-12-13_09:23:33.451883) 09:23:36.609306 run osmo-hlr_10.42.42.2(pid=31137): stderr: | 20221213092333624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092333624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092333625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092333625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092333625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092333625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092333637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092333646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092333646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092333646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:36.659513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31136): Terminating (SIGTERM) 09:23:36.700025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31139): Terminating (SIGTERM) 09:23:36.740660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31142): Terminating (SIGTERM) 09:23:36.781360 --- ParallelTerminationStrategy: PID 31136 died... 09:23:36.801066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31136): Terminated: ok {rc=0} 09:23:36.845585 --- ParallelTerminationStrategy: PID 31139 died... 09:23:36.864561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31139): Terminated: ok {rc=0} 09:23:36.908853 --- ParallelTerminationStrategy: PID 31142 died... 09:23:36.928479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31142): Terminated: ok {rc=0} 09:23:37.014928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:23:38.105443 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.117908 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:23:38.194152 tst ping_idle_ping.py: using LAC 33002 09:23:38.317142 tst ping_idle_ping.py: using RAC 107 09:23:38.438432 tst ping_idle_ping.py: using CellId 33002 09:23:38.562805 tst ping_idle_ping.py: using BVCI 33003 09:23:38.678106 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.689700 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.700749 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.711902 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.723585 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.735218 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.747088 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:38.758774 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:38.874227 tst ping_idle_ping.py:24: start network... 09:23:39.070111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:39.526133 run create_hlr_db(pid=31144): Launched 09:23:39.638008 bus /gobi_6: Setting Powered False 09:23:40.697426 run create_hlr_db(pid=31144): Terminated: ok {rc=0} 09:23:41.106554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31146): Launched 09:23:41.397663 run osmo-hlr_10.42.42.2(pid=31147): Launched 09:23:41.509128 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:42.022956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31149): Launched 09:23:42.314177 run osmo-stp_10.42.42.5(pid=31150): Launched 09:23:42.425652 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:42.927143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31152): Launched 09:23:43.038531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:43.284686 run patchelf(pid=31153): Launched 09:23:43.447181 run osmo-stp_10.42.42.5(pid=31150): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31150)] 09:23:43.571312 run osmo-stp_10.42.42.5(pid=31150): stdout: | (launched: 2022-12-13_09:23:42.260773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:43.696853 run osmo-stp_10.42.42.5(pid=31150): stderr: | 20221213092342430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092342431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092342431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092342431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092342432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092342432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092342432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:43.822914 run osmo-stp_10.42.42.5(pid=31150): stdout: | (launched: 2022-12-13_09:23:42.260773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:43.943165 run osmo-stp_10.42.42.5(pid=31150): stderr: | 20221213092342430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092342431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092342431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092342431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092342432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092342432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092342432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:44.085787 run patchelf(pid=31153): Terminating (SIGINT) 09:23:44.249624 run patchelf(pid=31153): Terminated: ok {rc=0} 09:23:44.367867 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31150): Process ended prematurely: osmo-stp_10.42.42.5(pid=31150) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31150)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:23:44.377506 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:23:44.404191 run osmo-hlr_10.42.42.2(pid=31147): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31147)] 09:23:44.452152 run osmo-hlr_10.42.42.2(pid=31147): stdout: | (launched: 2022-12-13_09:23:41.344444) 09:23:44.501367 run osmo-hlr_10.42.42.2(pid=31147): stderr: | 20221213092341520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092341520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092341520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092341520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092341520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092341520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092341532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092341540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092341540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092341540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:44.551169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31146): Terminating (SIGTERM) 09:23:44.591018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31149): Terminating (SIGTERM) 09:23:44.631048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31152): Terminating (SIGTERM) 09:23:44.671364 --- ParallelTerminationStrategy: PID 31146 died... 09:23:44.691032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31146): Terminated: ok {rc=0} 09:23:44.735232 --- ParallelTerminationStrategy: PID 31149 died... 09:23:44.754441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31149): Terminated: ok {rc=0} 09:23:44.799135 --- ParallelTerminationStrategy: PID 31152 died... 09:23:44.818524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31152): Terminated: ok {rc=0} 09:23:44.902216 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:23:46.214291 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:46.223280 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:23:46.265814 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:23:46.314720 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:23:46.414672 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:23:46.451977 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:23:46.496538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:23:47.124267 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:23:47.195568 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.208182 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:23:47.284232 tst cs_paging_gprs_active.py: using LAC 33003 09:23:47.455701 tst cs_paging_gprs_active.py: using RAC 108 09:23:47.606787 tst cs_paging_gprs_active.py: using CellId 33003 09:23:47.749880 tst cs_paging_gprs_active.py: using BVCI 33004 09:23:47.881388 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.897850 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.910254 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.924657 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.936937 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.955671 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.968912 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.982127 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:47.998524 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:23:48.131603 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:23:48.276591 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:23:48.529598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:48.924511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31320): Launched 09:23:49.281725 run iperf3-srv_10.42.42.10(pid=31366): Launched 09:23:49.438887 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:23:49.705104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:50.063206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31428): Launched 09:23:50.358774 run iperf3-srv_10.42.42.10(pid=31430): Launched 09:23:50.491976 tst cs_paging_gprs_active.py:38: start network... 09:23:50.713986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:51.228194 run create_hlr_db(pid=31431): Launched 09:23:51.392327 bus /gobi_6: Setting Powered False 09:23:52.457322 run create_hlr_db(pid=31431): Terminated: ok {rc=0} 09:23:52.915304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31435): Launched 09:23:53.254572 run osmo-hlr_10.42.42.2(pid=31436): Launched 09:23:53.499489 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:54.142843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31438): Launched 09:23:54.480004 run osmo-stp_10.42.42.5(pid=31439): Launched 09:23:54.734008 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:55.374042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31441): Launched 09:23:55.508705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:55.790409 run patchelf(pid=31442): Launched 09:23:55.987473 run osmo-stp_10.42.42.5(pid=31439): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31439)] 09:23:56.126524 run osmo-stp_10.42.42.5(pid=31439): stdout: | (launched: 2022-12-13_09:23:54.417149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:56.265649 run osmo-stp_10.42.42.5(pid=31439): stderr: | 20221213092354720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092354720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092354721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092354721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092354723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092354724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092354724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:56.406953 run osmo-stp_10.42.42.5(pid=31439): stdout: | (launched: 2022-12-13_09:23:54.417149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:56.541856 run osmo-stp_10.42.42.5(pid=31439): stderr: | 20221213092354720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092354720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092354721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092354721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092354723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092354724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092354724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:56.702495 run patchelf(pid=31442): Terminating (SIGINT) 09:23:56.885106 run patchelf(pid=31442): Terminated: ok {rc=0} 09:23:57.017153 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31439): Process ended prematurely: osmo-stp_10.42.42.5(pid=31439) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31439)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:23:57.028345 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 09:23:57.058091 run osmo-hlr_10.42.42.2(pid=31436): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31436)] 09:23:57.110532 run osmo-hlr_10.42.42.2(pid=31436): stdout: | (launched: 2022-12-13_09:23:53.190268) 09:23:57.163863 run osmo-hlr_10.42.42.2(pid=31436): stderr: | 20221213092353504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092353504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092353504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092353504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092353504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092353504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092353519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092353532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092353533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092353533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:57.218331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31320): Terminating (SIGTERM) 09:23:57.261544 run iperf3-srv_10.42.42.10(pid=31366): Terminating (SIGTERM) 09:23:57.308018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31428): Terminating (SIGTERM) 09:23:57.351873 run iperf3-srv_10.42.42.10(pid=31430): Terminating (SIGTERM) 09:23:57.397898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31435): Terminating (SIGTERM) 09:23:57.440909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31438): Terminating (SIGTERM) 09:23:57.486413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31441): Terminating (SIGTERM) 09:23:57.532355 --- ParallelTerminationStrategy: PID 31320 died... 09:23:57.553132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31320): Terminated: ok {rc=0} 09:23:57.601742 --- ParallelTerminationStrategy: PID 31366 died... 09:23:57.621862 run iperf3-srv_10.42.42.10(pid=31366): Terminated {rc=256} 09:23:57.669906 --- ParallelTerminationStrategy: PID 31428 died... 09:23:57.691278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31428): Terminated: ok {rc=0} 09:23:57.738002 --- ParallelTerminationStrategy: PID 31430 died... 09:23:57.758814 run iperf3-srv_10.42.42.10(pid=31430): Terminated {rc=256} 09:23:57.805529 --- ParallelTerminationStrategy: PID 31435 died... 09:23:57.827206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31435): Terminated: ok {rc=0} 09:23:57.873873 --- ParallelTerminationStrategy: PID 31438 died... 09:23:57.895519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31438): Terminated: ok {rc=0} 09:23:57.942020 --- ParallelTerminationStrategy: PID 31441 died... 09:23:57.962397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31441): Terminated: ok {rc=0} 09:23:58.051028 bus /gobi_0: Setting Powered False 09:23:59.153373 bus /gobi_0: Setting Powered False 09:24:00.273778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:24:01.460636 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:01.473537 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:24:01.549205 tst iperf3.py: using LAC 33004 09:24:01.718483 tst iperf3.py: using RAC 109 09:24:01.890277 tst iperf3.py: using CellId 33004 09:24:02.028462 tst iperf3.py: using BVCI 33005 09:24:02.150575 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.162747 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.174762 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.186698 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.198577 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.210354 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.222468 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.234652 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:02.246572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:02.375882 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:24:02.595276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:02.923645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31443): Launched 09:24:03.216076 run iperf3-srv_10.42.42.10(pid=31444): Launched 09:24:03.350680 tst iperf3.py:8: start network... 09:24:03.570317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:04.082240 run create_hlr_db(pid=31445): Launched 09:24:04.246894 bus /gobi_6: Setting Powered False 09:24:05.311713 run create_hlr_db(pid=31445): Terminated: ok {rc=0} 09:24:05.774571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31447): Launched 09:24:06.129740 run osmo-hlr_10.42.42.2(pid=31448): Launched 09:24:06.370899 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:07.053945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31450): Launched 09:24:07.393870 run osmo-stp_10.42.42.5(pid=31451): Launched 09:24:07.636399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:08.294852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31453): Launched 09:24:08.430343 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:08.719763 run patchelf(pid=31454): Launched 09:24:08.918411 run osmo-stp_10.42.42.5(pid=31451): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31451)] 09:24:09.057201 run osmo-stp_10.42.42.5(pid=31451): stdout: | (launched: 2022-12-13_09:24:07.330216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:09.199256 run osmo-stp_10.42.42.5(pid=31451): stderr: | 20221213092407640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092407640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092407640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092407640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092407641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092407641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092407641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:09.341092 run osmo-stp_10.42.42.5(pid=31451): stdout: | (launched: 2022-12-13_09:24:07.330216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:09.476246 run osmo-stp_10.42.42.5(pid=31451): stderr: | 20221213092407640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092407640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092407640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092407640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092407641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092407641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092407641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:09.636910 run patchelf(pid=31454): Terminating (SIGINT) 09:24:09.823670 run patchelf(pid=31454): Terminated: ok {rc=0} 09:24:09.958562 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31451): Process ended prematurely: osmo-stp_10.42.42.5(pid=31451) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31451)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 09:24:09.969686 tst iperf3.py:8: Test FAILED (8.6 sec) 09:24:09.999798 run osmo-hlr_10.42.42.2(pid=31448): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31448)] 09:24:10.052027 run osmo-hlr_10.42.42.2(pid=31448): stdout: | (launched: 2022-12-13_09:24:06.055074) 09:24:10.107372 run osmo-hlr_10.42.42.2(pid=31448): stderr: | 20221213092406375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092406375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092406375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092406375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092406375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092406375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092406395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092406407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092406407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092406408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:10.161462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31443): Terminating (SIGTERM) 09:24:10.207344 run iperf3-srv_10.42.42.10(pid=31444): Terminating (SIGTERM) 09:24:10.247711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31447): Terminating (SIGTERM) 09:24:10.287322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31450): Terminating (SIGTERM) 09:24:10.327021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31453): Terminating (SIGTERM) 09:24:10.366967 --- ParallelTerminationStrategy: PID 31443 died... 09:24:10.386472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31443): Terminated: ok {rc=0} 09:24:10.430331 --- ParallelTerminationStrategy: PID 31444 died... 09:24:10.448863 run iperf3-srv_10.42.42.10(pid=31444): Terminated {rc=256} 09:24:10.492177 --- ParallelTerminationStrategy: PID 31447 died... 09:24:10.511003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31447): Terminated: ok {rc=0} 09:24:10.554369 --- ParallelTerminationStrategy: PID 31450 died... 09:24:10.573394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31450): Terminated: ok {rc=0} 09:24:10.616806 --- ParallelTerminationStrategy: PID 31453 died... 09:24:10.636162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31453): Terminated: ok {rc=0} 09:24:10.718898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:24:11.864552 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:11.876446 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:24:11.948609 tst iperf3m4.py: using LAC 33005 09:24:12.074411 tst iperf3m4.py: using RAC 110 09:24:12.198268 tst iperf3m4.py: using CellId 33005 09:24:12.323685 tst iperf3m4.py: using BVCI 33006 09:24:12.438893 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.450449 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.461639 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.473261 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.484192 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.495345 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.506627 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.517675 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:12.528862 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:12.646201 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:12.768718 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:12.884545 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:13.003272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:24:13.217957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:13.536661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31456): Launched 09:24:13.813501 run iperf3-srv_10.42.42.10(pid=31457): Launched 09:24:13.932458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:24:14.146984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:14.466360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31458): Launched 09:24:14.743066 run iperf3-srv_10.42.42.10(pid=31459): Launched 09:24:14.861992 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:24:15.076345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:15.394748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31460): Launched 09:24:15.670502 run iperf3-srv_10.42.42.10(pid=31461): Launched 09:24:15.789478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:24:16.016142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:16.339032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31462): Launched 09:24:16.625193 run iperf3-srv_10.42.42.10(pid=31463): Launched 09:24:16.792842 tst iperf3m4.py:8: start network... 09:24:17.067194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:17.537726 run create_hlr_db(pid=31464): Launched 09:24:17.652307 bus /gobi_6: Setting Powered False 09:24:18.712706 run create_hlr_db(pid=31464): Terminated: ok {rc=0} 09:24:19.147108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31466): Launched 09:24:19.464602 run osmo-hlr_10.42.42.2(pid=31467): Launched 09:24:19.587029 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:20.113503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31469): Launched 09:24:20.410705 run osmo-stp_10.42.42.5(pid=31470): Launched 09:24:20.524847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:21.037249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31472): Launched 09:24:21.160782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:21.428535 run patchelf(pid=31473): Launched 09:24:21.604588 run osmo-stp_10.42.42.5(pid=31470): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31470)] 09:24:21.739649 run osmo-stp_10.42.42.5(pid=31470): stdout: | (launched: 2022-12-13_09:24:20.356374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:21.875609 run osmo-stp_10.42.42.5(pid=31470): stderr: | 20221213092420525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092420525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092420525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092420526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092420526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092420526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092420526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:22.011657 run osmo-stp_10.42.42.5(pid=31470): stdout: | (launched: 2022-12-13_09:24:20.356374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:22.142170 run osmo-stp_10.42.42.5(pid=31470): stderr: | 20221213092420525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092420525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092420525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092420526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092420526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092420526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092420526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:22.296657 run patchelf(pid=31473): Terminating (SIGINT) 09:24:22.474945 run patchelf(pid=31473): Terminated: ok {rc=0} 09:24:22.603033 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31470): Process ended prematurely: osmo-stp_10.42.42.5(pid=31470) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31470)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:24:22.613156 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:24:22.641538 run osmo-hlr_10.42.42.2(pid=31467): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31467)] 09:24:22.691911 run osmo-hlr_10.42.42.2(pid=31467): stdout: | (launched: 2022-12-13_09:24:19.406963) 09:24:22.743247 run osmo-hlr_10.42.42.2(pid=31467): stderr: | 20221213092419603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092419603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092419603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092419603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092419603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092419603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092419614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092419623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092419623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092419623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:22.794613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31456): Terminating (SIGTERM) 09:24:22.835992 run iperf3-srv_10.42.42.10(pid=31457): Terminating (SIGTERM) 09:24:22.877441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31458): Terminating (SIGTERM) 09:24:22.918951 run iperf3-srv_10.42.42.10(pid=31459): Terminating (SIGTERM) 09:24:22.960473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31460): Terminating (SIGTERM) 09:24:23.002160 run iperf3-srv_10.42.42.10(pid=31461): Terminating (SIGTERM) 09:24:23.043624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31462): Terminating (SIGTERM) 09:24:23.085047 run iperf3-srv_10.42.42.10(pid=31463): Terminating (SIGTERM) 09:24:23.127064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31466): Terminating (SIGTERM) 09:24:23.168654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31469): Terminating (SIGTERM) 09:24:23.210698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31472): Terminating (SIGTERM) 09:24:23.253758 --- ParallelTerminationStrategy: PID 31456 died... 09:24:23.273748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31456): Terminated: ok {rc=0} 09:24:23.319988 --- ParallelTerminationStrategy: PID 31457 died... 09:24:23.339455 run iperf3-srv_10.42.42.10(pid=31457): Terminated {rc=256} 09:24:23.385433 --- ParallelTerminationStrategy: PID 31458 died... 09:24:23.404795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31458): Terminated: ok {rc=0} 09:24:23.451237 --- ParallelTerminationStrategy: PID 31459 died... 09:24:23.470749 run iperf3-srv_10.42.42.10(pid=31459): Terminated {rc=256} 09:24:23.516685 --- ParallelTerminationStrategy: PID 31460 died... 09:24:23.536234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31460): Terminated: ok {rc=0} 09:24:23.582275 --- ParallelTerminationStrategy: PID 31461 died... 09:24:23.601835 run iperf3-srv_10.42.42.10(pid=31461): Terminated {rc=256} 09:24:23.647489 --- ParallelTerminationStrategy: PID 31462 died... 09:24:23.667089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31462): Terminated: ok {rc=0} 09:24:23.712922 --- ParallelTerminationStrategy: PID 31463 died... 09:24:23.732731 run iperf3-srv_10.42.42.10(pid=31463): Terminated {rc=256} 09:24:23.777987 --- ParallelTerminationStrategy: PID 31466 died... 09:24:23.797386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31466): Terminated: ok {rc=0} 09:24:23.842579 --- ParallelTerminationStrategy: PID 31469 died... 09:24:23.861936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31469): Terminated: ok {rc=0} 09:24:23.907261 --- ParallelTerminationStrategy: PID 31472 died... 09:24:23.926567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31472): Terminated: ok {rc=0} 09:24:24.014653 bus /gobi_4: Setting Powered False 09:24:25.112356 bus /gobi_4: Setting Powered False 09:24:26.226209 bus /gobi_1: Setting Powered False 09:24:27.322650 bus /gobi_1: Setting Powered False 09:24:28.439136 bus /gobi_0: Setting Powered False 09:24:29.535503 bus /gobi_0: Setting Powered False 09:24:30.648456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:24:31.751367 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:31.764209 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:24:31.841632 tst ping.py: using LAC 33006 09:24:31.963967 tst ping.py: using RAC 111 09:24:32.080614 tst ping.py: using CellId 33006 09:24:32.205991 tst ping.py: using BVCI 33007 09:24:32.322070 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:32.333779 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:32.345222 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:32.356459 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:32.368173 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:32.379842 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:32.391585 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:32.403330 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:32.524749 tst ping.py:19: start network... 09:24:32.735089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:33.217840 run create_hlr_db(pid=31475): Launched 09:24:33.344855 bus /gobi_6: Setting Powered False 09:24:34.405827 run create_hlr_db(pid=31475): Terminated: ok {rc=0} 09:24:34.822929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31477): Launched 09:24:35.135559 run osmo-hlr_10.42.42.2(pid=31478): Launched 09:24:35.254202 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:35.795195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31480): Launched 09:24:36.106423 run osmo-stp_10.42.42.5(pid=31481): Launched 09:24:36.224712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:36.763474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31483): Launched 09:24:36.883356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:37.146633 run patchelf(pid=31484): Launched 09:24:37.319953 run osmo-stp_10.42.42.5(pid=31481): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31481)] 09:24:37.452319 run osmo-stp_10.42.42.5(pid=31481): stdout: | (launched: 2022-12-13_09:24:36.049424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:37.586311 run osmo-stp_10.42.42.5(pid=31481): stderr: | 20221213092436240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092436241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092436241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092436241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092436242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092436242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092436242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:37.720918 run osmo-stp_10.42.42.5(pid=31481): stdout: | (launched: 2022-12-13_09:24:36.049424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:37.849365 run osmo-stp_10.42.42.5(pid=31481): stderr: | 20221213092436240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092436241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092436241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092436241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092436242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092436242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092436242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:38.001452 run patchelf(pid=31484): Terminating (SIGINT) 09:24:38.176151 run patchelf(pid=31484): Terminated: ok {rc=0} 09:24:38.302333 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31481): Process ended prematurely: osmo-stp_10.42.42.5(pid=31481) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31481)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 09:24:38.311790 tst ping.py:22: Test FAILED (6.6 sec) 09:24:38.340289 run osmo-hlr_10.42.42.2(pid=31478): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31478)] 09:24:38.389916 run osmo-hlr_10.42.42.2(pid=31478): stdout: | (launched: 2022-12-13_09:24:35.078632) 09:24:38.441220 run osmo-hlr_10.42.42.2(pid=31478): stderr: | 20221213092435274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092435274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092435274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092435274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092435274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092435274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092435288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092435297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092435297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092435297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:38.493198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31477): Terminating (SIGTERM) 09:24:38.534471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31480): Terminating (SIGTERM) 09:24:38.575949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31483): Terminating (SIGTERM) 09:24:38.617898 --- ParallelTerminationStrategy: PID 31477 died... 09:24:38.637531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31477): Terminated: ok {rc=0} 09:24:38.683839 --- ParallelTerminationStrategy: PID 31480 died... 09:24:38.703406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31480): Terminated: ok {rc=0} 09:24:38.749308 --- ParallelTerminationStrategy: PID 31483 died... 09:24:38.768909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31483): Terminated: ok {rc=0} 09:24:38.855954 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:24:39.942725 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:39.954864 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:24:40.027818 tst ping_idle_ping.py: using LAC 33007 09:24:40.152445 tst ping_idle_ping.py: using RAC 112 09:24:40.274994 tst ping_idle_ping.py: using CellId 33007 09:24:40.397381 tst ping_idle_ping.py: using BVCI 33008 09:24:40.510662 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:40.522076 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:40.533571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:40.544794 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:40.556071 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:40.567341 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:40.578700 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:40.590516 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:40.709487 tst ping_idle_ping.py:24: start network... 09:24:40.919648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:41.406623 run create_hlr_db(pid=31485): Launched 09:24:41.533649 bus /gobi_6: Setting Powered False 09:24:42.596071 run create_hlr_db(pid=31485): Terminated: ok {rc=0} 09:24:43.014793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31487): Launched 09:24:43.306472 run osmo-hlr_10.42.42.2(pid=31488): Launched 09:24:43.418742 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:43.935887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31490): Launched 09:24:44.227517 run osmo-stp_10.42.42.5(pid=31491): Launched 09:24:44.339731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:44.843834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31493): Launched 09:24:44.955535 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:45.202077 run patchelf(pid=31494): Launched 09:24:45.364413 run osmo-stp_10.42.42.5(pid=31491): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31491)] 09:24:45.488446 run osmo-stp_10.42.42.5(pid=31491): stdout: | (launched: 2022-12-13_09:24:44.174005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:45.613977 run osmo-stp_10.42.42.5(pid=31491): stderr: | 20221213092444342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092444342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092444342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092444343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092444343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092444343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092444343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:45.739513 run osmo-stp_10.42.42.5(pid=31491): stdout: | (launched: 2022-12-13_09:24:44.174005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:45.880425 run osmo-stp_10.42.42.5(pid=31491): stderr: | 20221213092444342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092444342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092444342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092444343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092444343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092444343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092444343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:46.048587 run patchelf(pid=31494): Terminating (SIGINT) 09:24:46.229089 run patchelf(pid=31494): Terminated: ok {rc=0} 09:24:46.359599 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31491): Process ended prematurely: osmo-stp_10.42.42.5(pid=31491) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31491)] [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:24:46.369847 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:24:46.398889 run osmo-hlr_10.42.42.2(pid=31488): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31488)] 09:24:46.450523 run osmo-hlr_10.42.42.2(pid=31488): stdout: | (launched: 2022-12-13_09:24:43.253247) 09:24:46.504605 run osmo-hlr_10.42.42.2(pid=31488): stderr: | 20221213092443425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092443425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092443425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092443425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092443425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092443425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092443437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092443446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092443446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092443446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:46.559069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31487): Terminating (SIGTERM) 09:24:46.602793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31490): Terminating (SIGTERM) 09:24:46.647628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31493): Terminating (SIGTERM) 09:24:46.695216 --- ParallelTerminationStrategy: PID 31487 died... 09:24:46.717177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31487): Terminated: ok {rc=0} 09:24:46.767473 --- ParallelTerminationStrategy: PID 31490 died... 09:24:46.787804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31490): Terminated: ok {rc=0} 09:24:46.835055 --- ParallelTerminationStrategy: PID 31493 died... 09:24:46.856328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31493): Terminated: ok {rc=0} 09:24:46.952007 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:24:48.273900 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:48.280764 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:24:48.314232 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:24:48.349531 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:24:48.402621 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:24:48.436358 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:24:48.471193 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:24:49.025840 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:24:49.031583 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.043122 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:24:49.114171 tst switch_tch_pdch.py: using LAC 33008 09:24:49.231673 tst switch_tch_pdch.py: using RAC 113 09:24:49.356397 tst switch_tch_pdch.py: using CellId 33008 09:24:49.479712 tst switch_tch_pdch.py: using BVCI 33009 09:24:49.593381 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.605126 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.616447 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.627814 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.639133 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.650486 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.662000 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:24:49.674183 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:24:49.789897 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:24:49.915844 tst switch_tch_pdch.py:51: start network... 09:24:50.112257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:50.563792 run create_hlr_db(pid=31498): Launched 09:24:50.675372 bus /gobi_6: Setting Powered False 09:24:51.733477 run create_hlr_db(pid=31498): Terminated: ok {rc=0} 09:24:52.158729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31500): Launched 09:24:52.469282 run osmo-hlr_10.42.42.2(pid=31501): Launched 09:24:52.588741 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:53.125491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31503): Launched 09:24:53.435342 run osmo-stp_10.42.42.5(pid=31504): Launched 09:24:53.553736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:54.091027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31506): Launched 09:24:54.208915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:54.470893 run patchelf(pid=31507): Launched 09:24:54.643716 run osmo-stp_10.42.42.5(pid=31504): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31504)] 09:24:54.775921 run osmo-stp_10.42.42.5(pid=31504): stdout: | (launched: 2022-12-13_09:24:53.378807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:54.908836 run osmo-stp_10.42.42.5(pid=31504): stderr: | 20221213092453568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092453568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092453569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092453569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092453571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092453572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092453572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:55.042338 run osmo-stp_10.42.42.5(pid=31504): stdout: | (launched: 2022-12-13_09:24:53.378807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:55.169596 run osmo-stp_10.42.42.5(pid=31504): stderr: | 20221213092453568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092453568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092453569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092453569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092453571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092453572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092453572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:55.321061 run patchelf(pid=31507): Terminating (SIGINT) 09:24:55.494746 run patchelf(pid=31507): Terminated: ok {rc=0} 09:24:55.620470 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31504): Process ended prematurely: osmo-stp_10.42.42.5(pid=31504) [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31504)] [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:24:55.629905 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:24:55.657626 run osmo-hlr_10.42.42.2(pid=31501): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31501)] 09:24:55.707497 run osmo-hlr_10.42.42.2(pid=31501): stdout: | (launched: 2022-12-13_09:24:52.412665) 09:24:55.758715 run osmo-hlr_10.42.42.2(pid=31501): stderr: | 20221213092452609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092452609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092452609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092452609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092452609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092452609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092452622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092452630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092452630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092452630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:55.810228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31500): Terminating (SIGTERM) 09:24:55.851165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31503): Terminating (SIGTERM) 09:24:55.892468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31506): Terminating (SIGTERM) 09:24:55.934025 --- ParallelTerminationStrategy: PID 31500 died... 09:24:55.953872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31500): Terminated: ok {rc=0} 09:24:55.999382 --- ParallelTerminationStrategy: PID 31503 died... 09:24:56.018788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31503): Terminated: ok {rc=0} 09:24:56.064116 --- ParallelTerminationStrategy: PID 31506 died... 09:24:56.083410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31506): Terminated: ok {rc=0} 09:24:56.169898 bus /gobi_0: Setting Powered False 09:24:57.267015 bus /gobi_0: Setting Powered False 09:24:58.381100 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:24:59.632373 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:59.638689 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:24:59.672499 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:24:59.707995 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:24:59.761414 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:24:59.795321 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:24:59.831674 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:25:00.386038 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:25:00.392212 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:00.403344 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:25:00.472432 tst switch_tch_pdch.py: using LAC 33009 09:25:00.590888 tst switch_tch_pdch.py: using RAC 114 09:25:00.708519 tst switch_tch_pdch.py: using CellId 33009 09:25:00.834217 tst switch_tch_pdch.py: using BVCI 33010 09:25:00.964176 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:00.977338 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:00.989635 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:01.001904 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:01.014079 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:01.025755 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:01.037612 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:01.049396 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:25:01.173183 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:25:01.301197 tst switch_tch_pdch.py:51: start network... 09:25:01.507746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:01.952516 run create_hlr_db(pid=31518): Launched 09:25:02.099718 bus /gobi_6: Setting Powered False 09:25:03.158406 run create_hlr_db(pid=31518): Terminated: ok {rc=0} 09:25:03.559445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31526): Launched 09:25:03.870502 run osmo-hlr_10.42.42.2(pid=31527): Launched 09:25:03.985284 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:04.472862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31529): Launched 09:25:04.763019 run osmo-stp_10.42.42.5(pid=31530): Launched 09:25:04.873614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:05.352226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31532): Launched 09:25:05.463268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:05.708665 run patchelf(pid=31533): Launched 09:25:05.870941 run osmo-stp_10.42.42.5(pid=31530): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31530)] 09:25:05.994011 run osmo-stp_10.42.42.5(pid=31530): stdout: | (launched: 2022-12-13_09:25:04.709672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:06.118897 run osmo-stp_10.42.42.5(pid=31530): stderr: | 20221213092504879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092504880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092504880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092504880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092504881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092504881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092504881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:06.244026 run osmo-stp_10.42.42.5(pid=31530): stdout: | (launched: 2022-12-13_09:25:04.709672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:06.363877 run osmo-stp_10.42.42.5(pid=31530): stderr: | 20221213092504879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092504880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092504880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092504880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092504881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092504881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092504881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:06.505787 run patchelf(pid=31533): Terminating (SIGINT) 09:25:06.670432 run patchelf(pid=31533): Terminated: ok {rc=0} 09:25:06.789163 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31530): Process ended prematurely: osmo-stp_10.42.42.5(pid=31530) [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31530)] [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:25:06.797981 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 09:25:06.824392 run osmo-hlr_10.42.42.2(pid=31527): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31527)] 09:25:06.872075 run osmo-hlr_10.42.42.2(pid=31527): stdout: | (launched: 2022-12-13_09:25:03.814083) 09:25:06.921315 run osmo-hlr_10.42.42.2(pid=31527): stderr: | 20221213092503989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092503989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092503989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092503989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092503989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092503989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092504002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092504013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092504013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092504013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:06.971047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31526): Terminating (SIGTERM) 09:25:07.010589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31529): Terminating (SIGTERM) 09:25:07.050350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31532): Terminating (SIGTERM) 09:25:07.090068 --- ParallelTerminationStrategy: PID 31526 died... 09:25:07.109306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31526): Terminated: ok {rc=0} 09:25:07.153205 --- ParallelTerminationStrategy: PID 31529 died... 09:25:07.171995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31529): Terminated: ok {rc=0} 09:25:07.215745 --- ParallelTerminationStrategy: PID 31532 died... 09:25:07.234646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31532): Terminated: ok {rc=0} 09:25:07.317597 bus /gobi_0: Setting Powered False 09:25:08.413919 bus /gobi_0: Setting Powered False 09:25:09.530240 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:25:10.780051 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:10.785327 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:25:10.814954 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:25:10.822204 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:25:10.872618 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:25:10.902546 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:25:10.909676 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:25:11.454863 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:25:11.461095 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:25:11.473244 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:25:11.517361 tst mo_mt_sms.py: using LAC 33010 09:25:11.631528 tst mo_mt_sms.py: using RAC 115 09:25:11.744442 tst mo_mt_sms.py: using CellId 33010 09:25:11.857256 tst mo_mt_sms.py: using BVCI 33011 09:25:11.962408 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:25:12.080778 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:25:12.196008 tst mo_mt_sms.py:9: start nitb and bts... 09:25:12.392037 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:25:13.019977 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31571): Launched 09:25:13.345700 run osmo-nitb_10.42.42.2(pid=31638): Launched 09:25:13.527078 run osmo-nitb_10.42.42.2(pid=31638): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31638)] 09:25:13.661703 run osmo-nitb_10.42.42.2(pid=31638): stdout: | (launched: 2022-12-13_09:25:13.284709) 09:25:13.799002 run osmo-nitb_10.42.42.2(pid=31638): stderr: | (launched: 2022-12-13_09:25:13.333168) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:25:13.936090 run osmo-nitb_10.42.42.2(pid=31638): stdout: | (launched: 2022-12-13_09:25:13.284709) 09:25:14.068072 run osmo-nitb_10.42.42.2(pid=31638): stderr: | (launched: 2022-12-13_09:25:13.333168) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31638): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31638) [trial-2387↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31638)] 09:25:14.473799 tst osmo-nitb_10.42.42.2(pid=31638): stdout: | (launched: 2022-12-13_09:25:13.284709) 09:25:14.602639 tst osmo-nitb_10.42.42.2(pid=31638): stderr: | (launched: 2022-12-13_09:25:13.333168) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:25:14.744074 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31638): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31638) [trial-2387↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31638)] [trial-2387↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 09:25:14.752464 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 09:25:14.759232 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31571): Terminating (SIGTERM) 09:25:14.968740 --- ParallelTerminationStrategy: PID 31571 died... 09:25:14.989188 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31571): Terminated: ok {rc=0} 09:25:15.076099 bus /sierra_3: Setting Powered False 09:25:16.177448 bus /sierra_3: Setting Powered False 09:25:17.295962 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:25:18.489567 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:18.495142 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:25:18.525861 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:25:18.553204 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:25:18.605123 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:25:18.634847 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:25:18.662590 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:25:19.207959 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:25:19.213970 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:19.225888 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:25:19.271222 tst mo_mt_sms.py: using LAC 33011 09:25:19.396068 tst mo_mt_sms.py: using RAC 116 09:25:19.513273 tst mo_mt_sms.py: using CellId 33011 09:25:19.629732 tst mo_mt_sms.py: using BVCI 33012 09:25:19.735542 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:19.746385 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:19.757180 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:19.767739 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:19.778606 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:19.789424 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:25:19.905899 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:25:20.021353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:20.474460 run create_hlr_db(pid=31893): Launched 09:25:20.584769 bus /sierra_2: Setting Powered False 09:25:21.643714 run create_hlr_db(pid=31893): Terminated: ok {rc=0} 09:25:22.070391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31895): Launched 09:25:22.381118 run osmo-hlr_10.42.42.2(pid=31896): Launched 09:25:22.500177 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:23.039810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31898): Launched 09:25:23.367166 run osmo-stp_10.42.42.5(pid=31916): Launched 09:25:23.563803 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:24.203471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32075): Launched 09:25:24.529655 run osmo-msc_10.42.42.6(pid=32077): Launched 09:25:24.856754 run osmo-stp_10.42.42.5(pid=31916): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31916)] 09:25:25.117883 run osmo-stp_10.42.42.5(pid=31916): stdout: | (launched: 2022-12-13_09:25:23.304723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:25.379059 run osmo-stp_10.42.42.5(pid=31916): stderr: | 20221213092523609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092523610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092523610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092523610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092523611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092523611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092523611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:25.583344 run osmo-stp_10.42.42.5(pid=31916): stdout: | (launched: 2022-12-13_09:25:23.304723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:25.704257 run osmo-stp_10.42.42.5(pid=31916): stderr: | 20221213092523609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092523610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092523610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092523610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092523611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092523611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092523611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:25.848152 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31916): Process ended prematurely: osmo-stp_10.42.42.5(pid=31916) [trial-2387↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31916)] [trial-2387↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 09:25:25.857523 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 09:25:25.885045 run osmo-hlr_10.42.42.2(pid=31896): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31896)] 09:25:25.937341 run osmo-hlr_10.42.42.2(pid=31896): stdout: | (launched: 2022-12-13_09:25:22.324407) 09:25:25.988920 run osmo-hlr_10.42.42.2(pid=31896): stderr: | 20221213092522521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092522521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092522521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092522521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092522521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092522521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092522534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092522543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092522543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092522543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:26.061779 run osmo-msc_10.42.42.6(pid=32077): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32077)] 09:25:26.111802 run osmo-msc_10.42.42.6(pid=32077): stdout: | (launched: 2022-12-13_09:25:24.462840) 09:25:26.163329 run osmo-msc_10.42.42.6(pid=32077): stderr: | 20221213092525066 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092525066 DLGLOBAL DEBUG validating counter group 0x7f16945b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092525066 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092525066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092525066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092525067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092525068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092525069 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092525069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092525069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:26.216754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31895): Terminating (SIGTERM) 09:25:26.258440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31898): Terminating (SIGTERM) 09:25:26.303286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32075): Terminating (SIGTERM) 09:25:26.348228 --- ParallelTerminationStrategy: PID 31895 died... 09:25:26.369509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31895): Terminated: ok {rc=0} 09:25:26.417403 --- ParallelTerminationStrategy: PID 31898 died... 09:25:26.438233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31898): Terminated: ok {rc=0} 09:25:26.484702 --- ParallelTerminationStrategy: PID 32075 died... 09:25:26.506751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32075): Terminated: ok {rc=0} 09:25:26.594947 bus /sierra_3: Setting Powered False 09:25:27.695412 bus /sierra_3: Setting Powered False 09:25:28.813000 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:25:30.044767 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:30.048672 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:25:30.078476 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:25:30.085451 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:25:30.121637 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:25:30.151167 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:25:30.158095 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:25:30.678746 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:25:30.684893 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:25:30.697142 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:25:30.742320 tst assert_extension.py: using LAC 33012 09:25:30.892185 tst assert_extension.py: using RAC 117 09:25:31.015832 tst assert_extension.py: using CellId 33012 09:25:31.139361 tst assert_extension.py: using BVCI 33013 09:25:31.255252 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:25:31.377088 tst assert_extension.py:10: start nitb and bts... 09:25:31.598321 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:25:32.272091 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32083): Launched 09:25:32.578303 run osmo-nitb_10.42.42.2(pid=32084): Launched 09:25:32.740509 run osmo-nitb_10.42.42.2(pid=32084): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32084)] 09:25:32.871997 run osmo-nitb_10.42.42.2(pid=32084): stdout: | (launched: 2022-12-13_09:25:32.525119) 09:25:33.005862 run osmo-nitb_10.42.42.2(pid=32084): stderr: | (launched: 2022-12-13_09:25:32.568412) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:25:33.139469 run osmo-nitb_10.42.42.2(pid=32084): stdout: | (launched: 2022-12-13_09:25:32.525119) 09:25:33.267732 run osmo-nitb_10.42.42.2(pid=32084): stderr: | (launched: 2022-12-13_09:25:32.568412) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32084): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32084) [trial-2387↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32084)] 09:25:33.688566 tst osmo-nitb_10.42.42.2(pid=32084): stdout: | (launched: 2022-12-13_09:25:32.525119) 09:25:33.806312 tst osmo-nitb_10.42.42.2(pid=32084): stderr: | (launched: 2022-12-13_09:25:32.568412) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:25:33.945414 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32084): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32084) [trial-2387↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32084)] [trial-2387↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 09:25:33.953558 tst assert_extension.py:12: Test FAILED (3.3 sec) 09:25:33.960061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32083): Terminating (SIGTERM) 09:25:34.168240 --- ParallelTerminationStrategy: PID 32083 died... 09:25:34.188623 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32083): Terminated: ok {rc=0} 09:25:34.274893 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:25:35.445133 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:35.450091 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:25:35.479447 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:25:35.506943 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:25:35.542650 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:25:35.572323 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:25:35.599763 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:25:36.129876 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:25:36.135158 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:36.146529 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:25:36.190712 tst assert_extension.py: using LAC 33013 09:25:36.308095 tst assert_extension.py: using RAC 118 09:25:36.421856 tst assert_extension.py: using CellId 33013 09:25:36.535830 tst assert_extension.py: using BVCI 33014 09:25:36.641449 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:36.652115 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:36.662668 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:36.673577 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:36.684358 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:25:36.695158 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:25:36.813728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:37.296018 run create_hlr_db(pid=32088): Launched 09:25:37.423668 bus /sierra_2: Setting Powered False 09:25:38.485278 run create_hlr_db(pid=32088): Terminated: ok {rc=0} 09:25:38.901099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32090): Launched 09:25:39.192310 run osmo-hlr_10.42.42.2(pid=32091): Launched 09:25:39.304287 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:39.821682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32093): Launched 09:25:40.112911 run osmo-stp_10.42.42.5(pid=32094): Launched 09:25:40.225040 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:40.751285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32096): Launched 09:25:41.041067 run osmo-msc_10.42.42.6(pid=32097): Launched 09:25:41.203843 run osmo-stp_10.42.42.5(pid=32094): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32094)] 09:25:41.328413 run osmo-stp_10.42.42.5(pid=32094): stdout: | (launched: 2022-12-13_09:25:40.059556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:41.453067 run osmo-stp_10.42.42.5(pid=32094): stderr: | 20221213092540228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092540228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092540228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092540229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092540229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092540229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092540229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:41.575347 run osmo-stp_10.42.42.5(pid=32094): stdout: | (launched: 2022-12-13_09:25:40.059556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:41.691343 run osmo-stp_10.42.42.5(pid=32094): stderr: | 20221213092540228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092540228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092540228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092540229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092540229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092540229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092540229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:41.830533 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32094): Process ended prematurely: osmo-stp_10.42.42.5(pid=32094) [trial-2387↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32094)] [trial-2387↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 09:25:41.838603 tst assert_extension.py:17: Test FAILED (5.7 sec) 09:25:41.864210 run osmo-hlr_10.42.42.2(pid=32091): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32091)] 09:25:41.915878 run osmo-hlr_10.42.42.2(pid=32091): stdout: | (launched: 2022-12-13_09:25:39.139229) 09:25:41.966013 run osmo-hlr_10.42.42.2(pid=32091): stderr: | 20221213092539314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092539315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092539315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092539315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092539315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092539315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092539328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092539338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092539338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092539338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:42.034947 run osmo-msc_10.42.42.6(pid=32097): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32097)] 09:25:42.082015 run osmo-msc_10.42.42.6(pid=32097): stdout: | (launched: 2022-12-13_09:25:40.987944) 09:25:42.131383 run osmo-msc_10.42.42.6(pid=32097): stderr: | 20221213092541258 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092541258 DLGLOBAL DEBUG validating counter group 0x7f1ddbc63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092541259 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092541259 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092541259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092541259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092541261 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092541261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092541262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092541262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:42.181185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32090): Terminating (SIGTERM) 09:25:42.221132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32093): Terminating (SIGTERM) 09:25:42.260783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32096): Terminating (SIGTERM) 09:25:42.300740 --- ParallelTerminationStrategy: PID 32090 died... 09:25:42.320237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32090): Terminated: ok {rc=0} 09:25:42.364172 --- ParallelTerminationStrategy: PID 32093 died... 09:25:42.382952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32093): Terminated: ok {rc=0} 09:25:42.426746 --- ParallelTerminationStrategy: PID 32096 died... 09:25:42.445615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32096): Terminated: ok {rc=0} 09:25:42.529661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:25:43.735457 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:43.743038 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:25:43.772820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:25:43.800575 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:25:43.852240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:25:43.882074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:25:43.909265 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:25:44.462844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:25:44.514529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:44.526459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:25:44.593433 tst mo_mt_call.py: using LAC 33014 09:25:44.719768 tst mo_mt_call.py: using RAC 119 09:25:44.845350 tst mo_mt_call.py: using CellId 33014 09:25:44.970604 tst mo_mt_call.py: using BVCI 33015 09:25:45.085572 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:45.097332 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:45.108769 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:45.120298 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:45.132016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:45.143527 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:25:45.260002 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:25:45.374873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:45.844014 run create_hlr_db(pid=32102): Launched 09:25:46.000886 bus /sierra_2: Setting Powered False 09:25:47.063972 run create_hlr_db(pid=32102): Terminated: ok {rc=0} 09:25:47.510484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32104): Launched 09:25:47.808424 run osmo-hlr_10.42.42.2(pid=32105): Launched 09:25:47.922411 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:48.472258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32107): Launched 09:25:48.789131 run osmo-stp_10.42.42.5(pid=32108): Launched 09:25:48.909890 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:49.483107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32110): Launched 09:25:49.800461 run osmo-msc_10.42.42.6(pid=32111): Launched 09:25:49.977240 run osmo-stp_10.42.42.5(pid=32108): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32108)] 09:25:50.110860 run osmo-stp_10.42.42.5(pid=32108): stdout: | (launched: 2022-12-13_09:25:48.731456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:50.245109 run osmo-stp_10.42.42.5(pid=32108): stderr: | 20221213092548926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092548926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092548926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092548927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092548927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092548927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092548927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:50.378982 run osmo-stp_10.42.42.5(pid=32108): stdout: | (launched: 2022-12-13_09:25:48.731456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:50.505304 run osmo-stp_10.42.42.5(pid=32108): stderr: | 20221213092548926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092548926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092548926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092548927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092548927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092548927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092548927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:50.656530 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32108): Process ended prematurely: osmo-stp_10.42.42.5(pid=32108) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32108)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:25:50.666301 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:25:50.693918 run osmo-hlr_10.42.42.2(pid=32105): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32105)] 09:25:50.744081 run osmo-hlr_10.42.42.2(pid=32105): stdout: | (launched: 2022-12-13_09:25:47.753953) 09:25:50.795643 run osmo-hlr_10.42.42.2(pid=32105): stderr: | 20221213092547930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092547930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092547930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092547930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092547930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092547930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092547942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092547951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092547951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092547951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:50.867530 run osmo-msc_10.42.42.6(pid=32111): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32111)] 09:25:50.917226 run osmo-msc_10.42.42.6(pid=32111): stdout: | (launched: 2022-12-13_09:25:49.742898) 09:25:50.968643 run osmo-msc_10.42.42.6(pid=32111): stderr: | 20221213092550068 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092550068 DLGLOBAL DEBUG validating counter group 0x7f1c11f97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092550068 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092550068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092550068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092550069 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092550070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092550071 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092550071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092550071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:51.020491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32104): Terminating (SIGTERM) 09:25:51.061995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32107): Terminating (SIGTERM) 09:25:51.103665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32110): Terminating (SIGTERM) 09:25:51.146246 --- ParallelTerminationStrategy: PID 32104 died... 09:25:51.166401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32104): Terminated: ok {rc=0} 09:25:51.212598 --- ParallelTerminationStrategy: PID 32107 died... 09:25:51.232540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32107): Terminated: ok {rc=0} 09:25:51.278721 --- ParallelTerminationStrategy: PID 32110 died... 09:25:51.298514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32110): Terminated: ok {rc=0} 09:25:51.386132 bus /sierra_3: Setting Powered False 09:25:52.483109 bus /sierra_3: Setting Powered False 09:25:53.601058 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:25:54.744786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:54.756524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:25:54.821109 tst mo_mt_call_osmux.py: using LAC 33015 09:25:54.938629 tst mo_mt_call_osmux.py: using RAC 120 09:25:55.057031 tst mo_mt_call_osmux.py: using CellId 33015 09:25:55.181886 tst mo_mt_call_osmux.py: using BVCI 33016 09:25:55.296643 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:55.308547 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:55.320080 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:55.331754 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:55.343361 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:25:55.355559 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:25:55.472093 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:25:55.588392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:56.080633 run create_hlr_db(pid=32114): Launched 09:25:56.210181 bus /sierra_2: Setting Powered False 09:25:57.273338 run create_hlr_db(pid=32114): Terminated: ok {rc=0} 09:25:57.698403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32116): Launched 09:25:57.996390 run osmo-hlr_10.42.42.2(pid=32117): Launched 09:25:58.110441 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:58.635105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32119): Launched 09:25:58.931542 run osmo-stp_10.42.42.5(pid=32120): Launched 09:25:59.044769 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:59.585665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32122): Launched 09:25:59.881446 run osmo-msc_10.42.42.6(pid=32123): Launched 09:26:00.048587 run osmo-stp_10.42.42.5(pid=32120): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32120)] 09:26:00.175358 run osmo-stp_10.42.42.5(pid=32120): stdout: | (launched: 2022-12-13_09:25:58.877118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:00.301383 run osmo-stp_10.42.42.5(pid=32120): stderr: | 20221213092559043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092559044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092559044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092559044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092559047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092559047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092559047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:00.425086 run osmo-stp_10.42.42.5(pid=32120): stdout: | (launched: 2022-12-13_09:25:58.877118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:00.543123 run osmo-stp_10.42.42.5(pid=32120): stderr: | 20221213092559043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092559044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092559044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092559044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092559047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092559047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092559047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:00.684685 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32120): Process ended prematurely: osmo-stp_10.42.42.5(pid=32120) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32120)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:26:00.693465 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:26:00.719648 run osmo-hlr_10.42.42.2(pid=32117): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32117)] 09:26:00.767318 run osmo-hlr_10.42.42.2(pid=32117): stdout: | (launched: 2022-12-13_09:25:57.942129) 09:26:00.816156 run osmo-hlr_10.42.42.2(pid=32117): stderr: | 20221213092558118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092558118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092558118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092558118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092558118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092558118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092558130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092558140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092558141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092558141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:00.889322 run osmo-msc_10.42.42.6(pid=32123): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32123)] 09:26:00.949110 run osmo-msc_10.42.42.6(pid=32123): stdout: | (launched: 2022-12-13_09:25:59.827273) 09:26:00.998388 run osmo-msc_10.42.42.6(pid=32123): stderr: | 20221213092600100 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092600101 DLGLOBAL DEBUG validating counter group 0x7f2707da6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092600101 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092600101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092600101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092600101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092600103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092600103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092600104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092600104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:01.049230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32116): Terminating (SIGTERM) 09:26:01.089977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32119): Terminating (SIGTERM) 09:26:01.130810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32122): Terminating (SIGTERM) 09:26:01.173274 --- ParallelTerminationStrategy: PID 32116 died... 09:26:01.192554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32116): Terminated: ok {rc=0} 09:26:01.237117 --- ParallelTerminationStrategy: PID 32119 died... 09:26:01.256377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32119): Terminated: ok {rc=0} 09:26:01.329910 --- ParallelTerminationStrategy: PID 32122 died... 09:26:01.358372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32122): Terminated: ok {rc=0} 09:26:01.455970 bus /sierra_3: Setting Powered False 09:26:02.549708 bus /sierra_3: Setting Powered False 09:26:03.663465 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:26:04.912840 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:04.920290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:26:04.950928 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:26:04.978329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:26:05.030793 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:26:05.061352 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:26:05.089528 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:26:05.639907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:26:05.691835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:05.703923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:26:05.774094 tst mo_mt_call.py: using LAC 33016 09:26:05.900942 tst mo_mt_call.py: using RAC 121 09:26:06.025414 tst mo_mt_call.py: using CellId 33016 09:26:06.153415 tst mo_mt_call.py: using BVCI 33017 09:26:06.270461 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:06.282203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:06.293682 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:06.305660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:06.317332 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:06.328708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:26:06.445414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:26:06.566058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:07.060505 run create_hlr_db(pid=32128): Launched 09:26:07.189878 bus /sierra_2: Setting Powered False 09:26:08.252904 run create_hlr_db(pid=32128): Terminated: ok {rc=0} 09:26:08.678074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32130): Launched 09:26:08.974470 run osmo-hlr_10.42.42.2(pid=32131): Launched 09:26:09.087614 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:09.598264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32133): Launched 09:26:09.895184 run osmo-stp_10.42.42.5(pid=32134): Launched 09:26:10.007968 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:10.546653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32136): Launched 09:26:10.844116 run osmo-msc_10.42.42.6(pid=32137): Launched 09:26:11.010765 run osmo-stp_10.42.42.5(pid=32134): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32134)] 09:26:11.137689 run osmo-stp_10.42.42.5(pid=32134): stdout: | (launched: 2022-12-13_09:26:09.840566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:11.264068 run osmo-stp_10.42.42.5(pid=32134): stderr: | 20221213092610010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092610010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092610010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092610011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092610011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092610011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092610011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:11.388255 run osmo-stp_10.42.42.5(pid=32134): stdout: | (launched: 2022-12-13_09:26:09.840566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:11.507037 run osmo-stp_10.42.42.5(pid=32134): stderr: | 20221213092610010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092610010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092610010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092610011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092610011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092610011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092610011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:11.649690 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32134): Process ended prematurely: osmo-stp_10.42.42.5(pid=32134) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32134)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:26:11.658419 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:26:11.684482 run osmo-hlr_10.42.42.2(pid=32131): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32131)] 09:26:11.733089 run osmo-hlr_10.42.42.2(pid=32131): stdout: | (launched: 2022-12-13_09:26:08.920181) 09:26:11.782190 run osmo-hlr_10.42.42.2(pid=32131): stderr: | 20221213092609095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092609095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092609095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092609095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092609095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092609095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092609108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092609117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092609118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092609118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:11.851242 run osmo-msc_10.42.42.6(pid=32137): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32137)] 09:26:11.898455 run osmo-msc_10.42.42.6(pid=32137): stdout: | (launched: 2022-12-13_09:26:10.789554) 09:26:11.947318 run osmo-msc_10.42.42.6(pid=32137): stderr: | 20221213092611061 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092611061 DLGLOBAL DEBUG validating counter group 0x7fe49a5e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092611061 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092611061 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092611061 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092611061 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092611063 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092611063 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092611064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092611064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:11.996614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32130): Terminating (SIGTERM) 09:26:12.036043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32133): Terminating (SIGTERM) 09:26:12.075427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32136): Terminating (SIGTERM) 09:26:12.115220 --- ParallelTerminationStrategy: PID 32130 died... 09:26:12.134544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32130): Terminated: ok {rc=0} 09:26:12.178101 --- ParallelTerminationStrategy: PID 32133 died... 09:26:12.196761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32133): Terminated: ok {rc=0} 09:26:12.240206 --- ParallelTerminationStrategy: PID 32136 died... 09:26:12.258918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32136): Terminated: ok {rc=0} 09:26:12.343962 bus /sierra_3: Setting Powered False 09:26:13.442898 bus /sierra_3: Setting Powered False 09:26:14.555889 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:26:15.699516 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:15.711326 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:26:15.777676 tst mo_mt_call_osmux.py: using LAC 33017 09:26:15.930290 tst mo_mt_call_osmux.py: using RAC 122 09:26:16.060102 tst mo_mt_call_osmux.py: using CellId 33017 09:26:16.187183 tst mo_mt_call_osmux.py: using BVCI 33018 09:26:16.338362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:16.354948 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:16.371190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:16.388219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:16.405551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:16.422738 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:26:16.567258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:26:16.695685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:17.172788 run create_hlr_db(pid=32139): Launched 09:26:17.290421 bus /sierra_2: Setting Powered False 09:26:18.354190 run create_hlr_db(pid=32139): Terminated: ok {rc=0} 09:26:18.779111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32141): Launched 09:26:19.074791 run osmo-hlr_10.42.42.2(pid=32142): Launched 09:26:19.188459 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:19.714330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32144): Launched 09:26:20.011319 run osmo-stp_10.42.42.5(pid=32145): Launched 09:26:20.124680 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:20.662086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32147): Launched 09:26:20.958948 run osmo-msc_10.42.42.6(pid=32148): Launched 09:26:21.125247 run osmo-stp_10.42.42.5(pid=32145): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32145)] 09:26:21.252168 run osmo-stp_10.42.42.5(pid=32145): stdout: | (launched: 2022-12-13_09:26:19.956571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:21.378333 run osmo-stp_10.42.42.5(pid=32145): stderr: | 20221213092620127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092620127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092620127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092620127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092620128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092620128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092620128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:21.502378 run osmo-stp_10.42.42.5(pid=32145): stdout: | (launched: 2022-12-13_09:26:19.956571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:21.621319 run osmo-stp_10.42.42.5(pid=32145): stderr: | 20221213092620127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092620127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092620127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092620127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092620128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092620128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092620128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:21.763598 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32145): Process ended prematurely: osmo-stp_10.42.42.5(pid=32145) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32145)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:26:21.772406 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:26:21.798604 run osmo-hlr_10.42.42.2(pid=32142): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32142)] 09:26:21.846075 run osmo-hlr_10.42.42.2(pid=32142): stdout: | (launched: 2022-12-13_09:26:19.020819) 09:26:21.895268 run osmo-hlr_10.42.42.2(pid=32142): stderr: | 20221213092619197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092619197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092619197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092619197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092619197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092619198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092619212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092619222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092619222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092619222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:21.964134 run osmo-msc_10.42.42.6(pid=32148): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32148)] 09:26:22.010984 run osmo-msc_10.42.42.6(pid=32148): stdout: | (launched: 2022-12-13_09:26:20.904305) 09:26:22.060401 run osmo-msc_10.42.42.6(pid=32148): stderr: | 20221213092621175 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092621175 DLGLOBAL DEBUG validating counter group 0x7fc233eeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092621175 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092621175 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092621176 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092621176 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092621178 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092621178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092621178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092621178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:22.109610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32141): Terminating (SIGTERM) 09:26:22.148811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32144): Terminating (SIGTERM) 09:26:22.188197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32147): Terminating (SIGTERM) 09:26:22.227903 --- ParallelTerminationStrategy: PID 32141 died... 09:26:22.247167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32141): Terminated: ok {rc=0} 09:26:22.290939 --- ParallelTerminationStrategy: PID 32144 died... 09:26:22.309708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32144): Terminated: ok {rc=0} 09:26:22.353282 --- ParallelTerminationStrategy: PID 32147 died... 09:26:22.371821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32147): Terminated: ok {rc=0} 09:26:22.456941 bus /sierra_3: Setting Powered False 09:26:23.554482 bus /sierra_3: Setting Powered False 09:26:24.668721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:26:25.915701 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:25.922968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:26:25.951438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:26:25.978625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:26:26.029905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:26:26.060071 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:26:26.088067 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:26:26.640509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:26:26.692661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:26.704536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:26:26.772787 tst mo_mt_call.py: using LAC 33018 09:26:26.897676 tst mo_mt_call.py: using RAC 123 09:26:27.022501 tst mo_mt_call.py: using CellId 33018 09:26:27.145908 tst mo_mt_call.py: using BVCI 33019 09:26:27.261298 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:27.273206 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:27.284624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:27.296137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:27.308329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:27.320394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:26:27.438778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:26:27.554182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:28.016206 run create_hlr_db(pid=32153): Launched 09:26:28.130915 bus /sierra_2: Setting Powered False 09:26:29.190993 run create_hlr_db(pid=32153): Terminated: ok {rc=0} 09:26:29.626158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32155): Launched 09:26:29.946376 run osmo-hlr_10.42.42.2(pid=32156): Launched 09:26:30.068278 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:30.615370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32158): Launched 09:26:30.963773 run osmo-stp_10.42.42.5(pid=32159): Launched 09:26:31.193621 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:31.894116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32161): Launched 09:26:32.214836 run osmo-msc_10.42.42.6(pid=32162): Launched 09:26:32.388349 run osmo-stp_10.42.42.5(pid=32159): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32159)] 09:26:32.518340 run osmo-stp_10.42.42.5(pid=32159): stdout: | (launched: 2022-12-13_09:26:30.892200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:32.645758 run osmo-stp_10.42.42.5(pid=32159): stderr: | 20221213092631239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092631239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092631240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092631240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092631247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092631247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092631247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:32.771026 run osmo-stp_10.42.42.5(pid=32159): stdout: | (launched: 2022-12-13_09:26:30.892200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:32.890864 run osmo-stp_10.42.42.5(pid=32159): stderr: | 20221213092631239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092631239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092631240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092631240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092631247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092631247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092631247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:33.033636 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32159): Process ended prematurely: osmo-stp_10.42.42.5(pid=32159) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32159)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:26:33.042719 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:26:33.069255 run osmo-hlr_10.42.42.2(pid=32156): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32156)] 09:26:33.117320 run osmo-hlr_10.42.42.2(pid=32156): stdout: | (launched: 2022-12-13_09:26:29.888559) 09:26:33.166796 run osmo-hlr_10.42.42.2(pid=32156): stderr: | 20221213092630085 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092630085 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092630085 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092630085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092630085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092630085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092630099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092630109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092630109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092630109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:33.236398 run osmo-msc_10.42.42.6(pid=32162): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32162)] 09:26:33.283553 run osmo-msc_10.42.42.6(pid=32162): stdout: | (launched: 2022-12-13_09:26:32.153741) 09:26:33.333153 run osmo-msc_10.42.42.6(pid=32162): stderr: | 20221213092632431 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092632431 DLGLOBAL DEBUG validating counter group 0x7ff073cbac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092632431 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092632431 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092632431 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092632432 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092632433 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092632434 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092632434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092632434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:33.383133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32155): Terminating (SIGTERM) 09:26:33.423089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32158): Terminating (SIGTERM) 09:26:33.462937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32161): Terminating (SIGTERM) 09:26:33.503075 --- ParallelTerminationStrategy: PID 32155 died... 09:26:33.522797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32155): Terminated: ok {rc=0} 09:26:33.567115 --- ParallelTerminationStrategy: PID 32158 died... 09:26:33.586174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32158): Terminated: ok {rc=0} 09:26:33.630189 --- ParallelTerminationStrategy: PID 32161 died... 09:26:33.649225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32161): Terminated: ok {rc=0} 09:26:33.735253 bus /sierra_3: Setting Powered False 09:26:34.833349 bus /sierra_3: Setting Powered False 09:26:35.948312 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:26:37.092327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:37.104114 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:26:37.169340 tst mo_mt_call_osmux.py: using LAC 33019 09:26:37.287452 tst mo_mt_call_osmux.py: using RAC 124 09:26:37.411947 tst mo_mt_call_osmux.py: using CellId 33019 09:26:37.537865 tst mo_mt_call_osmux.py: using BVCI 33020 09:26:37.653777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:37.665838 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:37.677579 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:37.689405 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:37.701856 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:26:37.714193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:26:37.833439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:26:37.954196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:38.416923 run create_hlr_db(pid=32164): Launched 09:26:38.531615 bus /sierra_2: Setting Powered False 09:26:39.590829 run create_hlr_db(pid=32164): Terminated: ok {rc=0} 09:26:40.025621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32166): Launched 09:26:40.342027 run osmo-hlr_10.42.42.2(pid=32167): Launched 09:26:40.463851 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:41.011986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32169): Launched 09:26:41.330346 run osmo-stp_10.42.42.5(pid=32170): Launched 09:26:41.452192 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:42.029453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32172): Launched 09:26:42.346296 run osmo-msc_10.42.42.6(pid=32173): Launched 09:26:42.523957 run osmo-stp_10.42.42.5(pid=32170): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32170)] 09:26:42.663560 run osmo-stp_10.42.42.5(pid=32170): stdout: | (launched: 2022-12-13_09:26:41.272327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:42.798436 run osmo-stp_10.42.42.5(pid=32170): stderr: | 20221213092641464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092641464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092641464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092641465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092641465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092641465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092641465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:42.930385 run osmo-stp_10.42.42.5(pid=32170): stdout: | (launched: 2022-12-13_09:26:41.272327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:43.056722 run osmo-stp_10.42.42.5(pid=32170): stderr: | 20221213092641464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092641464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092641464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092641465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092641465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092641465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092641465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:43.208219 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32170): Process ended prematurely: osmo-stp_10.42.42.5(pid=32170) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32170)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:26:43.217971 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:26:43.245868 run osmo-hlr_10.42.42.2(pid=32167): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32167)] 09:26:43.295587 run osmo-hlr_10.42.42.2(pid=32167): stdout: | (launched: 2022-12-13_09:26:40.284263) 09:26:43.347018 run osmo-hlr_10.42.42.2(pid=32167): stderr: | 20221213092640479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092640479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092640479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092640479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092640479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092640479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092640491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092640501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092640501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092640501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:43.418700 run osmo-msc_10.42.42.6(pid=32173): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32173)] 09:26:43.467955 run osmo-msc_10.42.42.6(pid=32173): stdout: | (launched: 2022-12-13_09:26:42.288299) 09:26:43.519389 run osmo-msc_10.42.42.6(pid=32173): stderr: | 20221213092642612 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092642612 DLGLOBAL DEBUG validating counter group 0x7f46746a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092642612 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092642612 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092642612 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092642613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092642614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092642615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092642615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092642615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:43.570892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32166): Terminating (SIGTERM) 09:26:43.611894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32169): Terminating (SIGTERM) 09:26:43.653062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32172): Terminating (SIGTERM) 09:26:43.694496 --- ParallelTerminationStrategy: PID 32166 died... 09:26:43.714504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32166): Terminated: ok {rc=0} 09:26:43.760534 --- ParallelTerminationStrategy: PID 32169 died... 09:26:43.780209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32169): Terminated: ok {rc=0} 09:26:43.826308 --- ParallelTerminationStrategy: PID 32172 died... 09:26:43.845930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32172): Terminated: ok {rc=0} 09:26:43.932484 bus /sierra_3: Setting Powered False 09:26:45.029011 bus /sierra_3: Setting Powered False 09:26:46.143756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:26:47.400435 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:47.407391 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:26:47.437317 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:26:47.464779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:26:47.516704 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:26:47.546589 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:26:47.574675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:26:48.127106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:26:48.178882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:48.190555 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:26:48.258188 tst mo_mt_call.py: using LAC 33020 09:26:48.383151 tst mo_mt_call.py: using RAC 125 09:26:48.508070 tst mo_mt_call.py: using CellId 33020 09:26:48.637127 tst mo_mt_call.py: using BVCI 33021 09:26:48.754470 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:48.766153 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:48.777803 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:48.789216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:48.800715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:48.812160 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:26:48.928253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:26:49.045698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:49.506113 run create_hlr_db(pid=32178): Launched 09:26:49.621743 bus /sierra_2: Setting Powered False 09:26:50.681570 run create_hlr_db(pid=32178): Terminated: ok {rc=0} 09:26:51.117964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32180): Launched 09:26:51.436485 run osmo-hlr_10.42.42.2(pid=32181): Launched 09:26:51.558791 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:52.109215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32183): Launched 09:26:52.426384 run osmo-stp_10.42.42.5(pid=32184): Launched 09:26:52.547901 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:53.124789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32186): Launched 09:26:53.443105 run osmo-msc_10.42.42.6(pid=32187): Launched 09:26:53.621330 run osmo-stp_10.42.42.5(pid=32184): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32184)] 09:26:53.756442 run osmo-stp_10.42.42.5(pid=32184): stdout: | (launched: 2022-12-13_09:26:52.368592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:53.892513 run osmo-stp_10.42.42.5(pid=32184): stderr: | 20221213092652562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092652562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092652562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092652563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092652563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092652563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092652563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:54.026904 run osmo-stp_10.42.42.5(pid=32184): stdout: | (launched: 2022-12-13_09:26:52.368592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:54.153874 run osmo-stp_10.42.42.5(pid=32184): stderr: | 20221213092652562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092652562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092652562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092652563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092652563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092652563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092652563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:54.306233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32184): Process ended prematurely: osmo-stp_10.42.42.5(pid=32184) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32184)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:26:54.315778 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:26:54.343404 run osmo-hlr_10.42.42.2(pid=32181): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32181)] 09:26:54.392817 run osmo-hlr_10.42.42.2(pid=32181): stdout: | (launched: 2022-12-13_09:26:51.378476) 09:26:54.444129 run osmo-hlr_10.42.42.2(pid=32181): stderr: | 20221213092651578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092651578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092651579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092651579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092651579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092651579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092651594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092651602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092651602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092651602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:54.516139 run osmo-msc_10.42.42.6(pid=32187): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32187)] 09:26:54.565591 run osmo-msc_10.42.42.6(pid=32187): stdout: | (launched: 2022-12-13_09:26:53.385103) 09:26:54.616723 run osmo-msc_10.42.42.6(pid=32187): stderr: | 20221213092653708 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092653708 DLGLOBAL DEBUG validating counter group 0x7f96525f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092653708 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092653708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092653708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092653708 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092653710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092653710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092653711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092653711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:54.668391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32180): Terminating (SIGTERM) 09:26:54.709789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32183): Terminating (SIGTERM) 09:26:54.751613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32186): Terminating (SIGTERM) 09:26:54.793607 --- ParallelTerminationStrategy: PID 32180 died... 09:26:54.813512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32180): Terminated: ok {rc=0} 09:26:54.859417 --- ParallelTerminationStrategy: PID 32183 died... 09:26:54.878994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32183): Terminated: ok {rc=0} 09:26:54.924747 --- ParallelTerminationStrategy: PID 32186 died... 09:26:54.944186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32186): Terminated: ok {rc=0} 09:26:55.031580 bus /sierra_3: Setting Powered False 09:26:56.129153 bus /sierra_3: Setting Powered False 09:26:57.246716 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:26:58.388771 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:58.400499 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:26:58.465301 tst mo_mt_call_osmux.py: using LAC 33021 09:26:58.583734 tst mo_mt_call_osmux.py: using RAC 126 09:26:58.702424 tst mo_mt_call_osmux.py: using CellId 33021 09:26:58.828858 tst mo_mt_call_osmux.py: using BVCI 33022 09:26:58.946289 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:58.958210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:58.969788 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:58.981258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:58.993504 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:26:59.005736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:26:59.126963 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:26:59.244485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:59.707183 run create_hlr_db(pid=32189): Launched 09:26:59.821348 bus /sierra_2: Setting Powered False 09:27:00.909148 run create_hlr_db(pid=32189): Terminated: ok {rc=0} 09:27:01.370302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32191): Launched 09:27:01.690899 run osmo-hlr_10.42.42.2(pid=32192): Launched 09:27:01.949816 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:02.556131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32194): Launched 09:27:02.876069 run osmo-stp_10.42.42.5(pid=32195): Launched 09:27:02.998108 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:03.572476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32197): Launched 09:27:03.890186 run osmo-msc_10.42.42.6(pid=32198): Launched 09:27:04.068013 run osmo-stp_10.42.42.5(pid=32195): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32195)] 09:27:04.202127 run osmo-stp_10.42.42.5(pid=32195): stdout: | (launched: 2022-12-13_09:27:02.818176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:04.336150 run osmo-stp_10.42.42.5(pid=32195): stderr: | 20221213092703012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092703012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092703012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092703013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092703013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092703013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092703013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:04.470350 run osmo-stp_10.42.42.5(pid=32195): stdout: | (launched: 2022-12-13_09:27:02.818176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:04.596834 run osmo-stp_10.42.42.5(pid=32195): stderr: | 20221213092703012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092703012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092703012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092703013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092703013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092703013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092703013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:04.749204 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32195): Process ended prematurely: osmo-stp_10.42.42.5(pid=32195) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32195)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:27:04.758630 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:27:04.786352 run osmo-hlr_10.42.42.2(pid=32192): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32192)] 09:27:04.835755 run osmo-hlr_10.42.42.2(pid=32192): stdout: | (launched: 2022-12-13_09:27:01.630003) 09:27:04.887106 run osmo-hlr_10.42.42.2(pid=32192): stderr: | 20221213092701888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092701888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092701888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092701888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092701888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092701888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092701913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092701921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092701922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092701922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:04.958445 run osmo-msc_10.42.42.6(pid=32198): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32198)] 09:27:05.007738 run osmo-msc_10.42.42.6(pid=32198): stdout: | (launched: 2022-12-13_09:27:03.832461) 09:27:05.058831 run osmo-msc_10.42.42.6(pid=32198): stderr: | 20221213092704157 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092704157 DLGLOBAL DEBUG validating counter group 0x7fa266512c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092704157 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092704157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092704157 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092704158 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092704159 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092704159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092704160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092704160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:05.110375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32191): Terminating (SIGTERM) 09:27:05.151462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32194): Terminating (SIGTERM) 09:27:05.192556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32197): Terminating (SIGTERM) 09:27:05.234313 --- ParallelTerminationStrategy: PID 32191 died... 09:27:05.254233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32191): Terminated: ok {rc=0} 09:27:05.299828 --- ParallelTerminationStrategy: PID 32194 died... 09:27:05.319240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32194): Terminated: ok {rc=0} 09:27:05.364730 --- ParallelTerminationStrategy: PID 32197 died... 09:27:05.384199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32197): Terminated: ok {rc=0} 09:27:05.470663 bus /sierra_3: Setting Powered False 09:27:06.568277 bus /sierra_3: Setting Powered False 09:27:07.685571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:27:08.933463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:08.940340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:27:08.969482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:27:08.996718 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:27:09.048416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:27:09.078302 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:27:09.105482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:27:09.660046 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:27:09.708455 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:09.719805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:27:09.783820 tst mo_mt_call.py: using LAC 33022 09:27:09.901521 tst mo_mt_call.py: using RAC 127 09:27:10.021573 tst mo_mt_call.py: using CellId 33022 09:27:10.149762 tst mo_mt_call.py: using BVCI 33023 09:27:10.267014 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:10.278872 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:10.290432 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:10.302151 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:10.313735 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:10.325243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:10.440691 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:10.559952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:11.053683 run create_hlr_db(pid=32203): Launched 09:27:11.183316 bus /sierra_2: Setting Powered False 09:27:12.246599 run create_hlr_db(pid=32203): Terminated: ok {rc=0} 09:27:12.671844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32205): Launched 09:27:12.970233 run osmo-hlr_10.42.42.2(pid=32206): Launched 09:27:13.082834 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:13.613504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32208): Launched 09:27:13.932526 run osmo-stp_10.42.42.5(pid=32209): Launched 09:27:14.054215 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:14.629318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32211): Launched 09:27:14.948440 run osmo-msc_10.42.42.6(pid=32212): Launched 09:27:15.124773 run osmo-stp_10.42.42.5(pid=32209): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32209)] 09:27:15.260803 run osmo-stp_10.42.42.5(pid=32209): stdout: | (launched: 2022-12-13_09:27:13.874638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:15.396216 run osmo-stp_10.42.42.5(pid=32209): stderr: | 20221213092714066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092714066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092714066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092714067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092714067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092714067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092714067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:15.527673 run osmo-stp_10.42.42.5(pid=32209): stdout: | (launched: 2022-12-13_09:27:13.874638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:15.654160 run osmo-stp_10.42.42.5(pid=32209): stderr: | 20221213092714066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092714066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092714066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092714067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092714067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092714067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092714067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:15.805764 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32209): Process ended prematurely: osmo-stp_10.42.42.5(pid=32209) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32209)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:27:15.815475 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:27:15.843262 run osmo-hlr_10.42.42.2(pid=32206): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32206)] 09:27:15.899547 run osmo-hlr_10.42.42.2(pid=32206): stdout: | (launched: 2022-12-13_09:27:12.915703) 09:27:15.951649 run osmo-hlr_10.42.42.2(pid=32206): stderr: | 20221213092713092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092713092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092713092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092713092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092713092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092713092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092713112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092713121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092713121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092713121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:16.024523 run osmo-msc_10.42.42.6(pid=32212): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32212)] 09:27:16.079140 run osmo-msc_10.42.42.6(pid=32212): stdout: | (launched: 2022-12-13_09:27:14.890352) 09:27:16.131248 run osmo-msc_10.42.42.6(pid=32212): stderr: | 20221213092715215 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092715215 DLGLOBAL DEBUG validating counter group 0x7f0445a95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092715215 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092715215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092715215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092715215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092715217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092715217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092715218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092715218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:16.184017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32205): Terminating (SIGTERM) 09:27:16.226875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32208): Terminating (SIGTERM) 09:27:16.271014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32211): Terminating (SIGTERM) 09:27:16.315104 --- ParallelTerminationStrategy: PID 32205 died... 09:27:16.335624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32205): Terminated: ok {rc=0} 09:27:16.382259 --- ParallelTerminationStrategy: PID 32208 died... 09:27:16.402520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32208): Terminated: ok {rc=0} 09:27:16.449538 --- ParallelTerminationStrategy: PID 32211 died... 09:27:16.469819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32211): Terminated: ok {rc=0} 09:27:16.558638 bus /sierra_3: Setting Powered False 09:27:17.658912 bus /sierra_3: Setting Powered False 09:27:18.773031 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:27:19.918601 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:19.930901 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:27:20.001222 tst mo_mt_call_osmux.py: using LAC 33023 09:27:20.125692 tst mo_mt_call_osmux.py: using RAC 128 09:27:20.248854 tst mo_mt_call_osmux.py: using CellId 33023 09:27:20.373437 tst mo_mt_call_osmux.py: using BVCI 33024 09:27:20.482841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:20.494312 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:20.505636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:20.516745 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:20.528351 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:20.539877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:20.659751 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:20.776600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:21.238085 run create_hlr_db(pid=32214): Launched 09:27:21.351358 bus /sierra_2: Setting Powered False 09:27:22.411313 run create_hlr_db(pid=32214): Terminated: ok {rc=0} 09:27:22.846575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32216): Launched 09:27:23.165450 run osmo-hlr_10.42.42.2(pid=32217): Launched 09:27:23.287227 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:23.837944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32219): Launched 09:27:24.156289 run osmo-stp_10.42.42.5(pid=32220): Launched 09:27:24.277406 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:24.853064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32222): Launched 09:27:25.171303 run osmo-msc_10.42.42.6(pid=32223): Launched 09:27:25.350485 run osmo-stp_10.42.42.5(pid=32220): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32220)] 09:27:25.484875 run osmo-stp_10.42.42.5(pid=32220): stdout: | (launched: 2022-12-13_09:27:24.098015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:25.619626 run osmo-stp_10.42.42.5(pid=32220): stderr: | 20221213092724289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092724289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092724289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092724289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092724292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092724292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092724292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:25.754738 run osmo-stp_10.42.42.5(pid=32220): stdout: | (launched: 2022-12-13_09:27:24.098015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:25.881876 run osmo-stp_10.42.42.5(pid=32220): stderr: | 20221213092724289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092724289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092724289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092724289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092724292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092724292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092724292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:26.034642 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32220): Process ended prematurely: osmo-stp_10.42.42.5(pid=32220) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32220)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:27:26.044038 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:27:26.071809 run osmo-hlr_10.42.42.2(pid=32217): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32217)] 09:27:26.121580 run osmo-hlr_10.42.42.2(pid=32217): stdout: | (launched: 2022-12-13_09:27:23.107234) 09:27:26.173195 run osmo-hlr_10.42.42.2(pid=32217): stderr: | 20221213092723306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092723306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092723306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092723306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092723306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092723307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092723318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092723327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092723327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092723327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:26.245182 run osmo-msc_10.42.42.6(pid=32223): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32223)] 09:27:26.294728 run osmo-msc_10.42.42.6(pid=32223): stdout: | (launched: 2022-12-13_09:27:25.113225) 09:27:26.345975 run osmo-msc_10.42.42.6(pid=32223): stderr: | 20221213092725434 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092725434 DLGLOBAL DEBUG validating counter group 0x7f3f3afe7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092725434 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092725434 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092725434 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092725435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092725436 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092725437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092725437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092725437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:26.397722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32216): Terminating (SIGTERM) 09:27:26.438813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32219): Terminating (SIGTERM) 09:27:26.480149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32222): Terminating (SIGTERM) 09:27:26.522169 --- ParallelTerminationStrategy: PID 32216 died... 09:27:26.541863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32216): Terminated: ok {rc=0} 09:27:26.588050 --- ParallelTerminationStrategy: PID 32219 died... 09:27:26.607231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32219): Terminated: ok {rc=0} 09:27:26.653248 --- ParallelTerminationStrategy: PID 32222 died... 09:27:26.672640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32222): Terminated: ok {rc=0} 09:27:26.760002 bus /sierra_3: Setting Powered False 09:27:27.855697 bus /sierra_3: Setting Powered False 09:27:28.969099 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:27:30.217591 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:30.224397 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:27:30.254025 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:27:30.281548 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:27:30.333968 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:27:30.364173 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:27:30.391261 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:27:30.975345 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:27:31.029152 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:31.041669 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:27:31.110746 tst mo_mt_call.py: using LAC 33024 09:27:31.237646 tst mo_mt_call.py: using RAC 129 09:27:31.390455 tst mo_mt_call.py: using CellId 33024 09:27:31.517068 tst mo_mt_call.py: using BVCI 33025 09:27:31.662171 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:31.675724 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:31.688471 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:31.701172 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:31.714013 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:31.726840 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:31.859689 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:32.002630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:32.477582 run create_hlr_db(pid=32228): Launched 09:27:32.592147 bus /sierra_2: Setting Powered False 09:27:33.652661 run create_hlr_db(pid=32228): Terminated: ok {rc=0} 09:27:34.068204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32230): Launched 09:27:34.365435 run osmo-hlr_10.42.42.2(pid=32231): Launched 09:27:34.478823 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:34.996042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32233): Launched 09:27:35.292718 run osmo-stp_10.42.42.5(pid=32234): Launched 09:27:35.406537 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:35.946936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32236): Launched 09:27:36.249440 run osmo-msc_10.42.42.6(pid=32237): Launched 09:27:36.429260 run osmo-stp_10.42.42.5(pid=32234): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32234)] 09:27:36.565961 run osmo-stp_10.42.42.5(pid=32234): stdout: | (launched: 2022-12-13_09:27:35.238059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:36.703064 run osmo-stp_10.42.42.5(pid=32234): stderr: | 20221213092735409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092735409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092735409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092735409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092735410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092735410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092735410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:36.837792 run osmo-stp_10.42.42.5(pid=32234): stdout: | (launched: 2022-12-13_09:27:35.238059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:36.965884 run osmo-stp_10.42.42.5(pid=32234): stderr: | 20221213092735409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092735409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092735409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092735409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092735410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092735410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092735410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:37.118507 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32234): Process ended prematurely: osmo-stp_10.42.42.5(pid=32234) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32234)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:27:37.128125 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:27:37.156042 run osmo-hlr_10.42.42.2(pid=32231): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32231)] 09:27:37.206078 run osmo-hlr_10.42.42.2(pid=32231): stdout: | (launched: 2022-12-13_09:27:34.311004) 09:27:37.257599 run osmo-hlr_10.42.42.2(pid=32231): stderr: | 20221213092734487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092734487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092734487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092734487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092734487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092734487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092734512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092734522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092734522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092734522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:37.329627 run osmo-msc_10.42.42.6(pid=32237): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32237)] 09:27:37.379290 run osmo-msc_10.42.42.6(pid=32237): stdout: | (launched: 2022-12-13_09:27:36.189778) 09:27:37.430229 run osmo-msc_10.42.42.6(pid=32237): stderr: | 20221213092736511 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092736511 DLGLOBAL DEBUG validating counter group 0x7f13c33c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092736511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092736511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092736512 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092736512 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092736514 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092736514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092736514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092736514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:37.481915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32230): Terminating (SIGTERM) 09:27:37.523136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32233): Terminating (SIGTERM) 09:27:37.564483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32236): Terminating (SIGTERM) 09:27:37.606378 --- ParallelTerminationStrategy: PID 32230 died... 09:27:37.626369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32230): Terminated: ok {rc=0} 09:27:37.672395 --- ParallelTerminationStrategy: PID 32233 died... 09:27:37.691945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32233): Terminated: ok {rc=0} 09:27:37.738299 --- ParallelTerminationStrategy: PID 32236 died... 09:27:37.758088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32236): Terminated: ok {rc=0} 09:27:37.844761 bus /sierra_3: Setting Powered False 09:27:38.942644 bus /sierra_3: Setting Powered False 09:27:40.055049 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:27:41.197865 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:41.209817 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:27:41.276444 tst mo_mt_call_osmux.py: using LAC 33025 09:27:41.393771 tst mo_mt_call_osmux.py: using RAC 130 09:27:41.510514 tst mo_mt_call_osmux.py: using CellId 33025 09:27:41.629596 tst mo_mt_call_osmux.py: using BVCI 33026 09:27:41.747946 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:41.760317 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:41.772308 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:41.784207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:41.796613 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:41.809011 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:41.927277 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:42.047382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:42.543250 run create_hlr_db(pid=32239): Launched 09:27:42.672750 bus /sierra_2: Setting Powered False 09:27:43.736124 run create_hlr_db(pid=32239): Terminated: ok {rc=0} 09:27:44.180053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32241): Launched 09:27:44.498032 run osmo-hlr_10.42.42.2(pid=32242): Launched 09:27:44.619063 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:45.166257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32244): Launched 09:27:45.464392 run osmo-stp_10.42.42.5(pid=32245): Launched 09:27:45.579093 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:46.163719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32247): Launched 09:27:46.506252 run osmo-msc_10.42.42.6(pid=32248): Launched 09:27:46.787524 run osmo-stp_10.42.42.5(pid=32245): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32245)] 09:27:47.027694 run osmo-stp_10.42.42.5(pid=32245): stdout: | (launched: 2022-12-13_09:27:45.409861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:47.243625 run osmo-stp_10.42.42.5(pid=32245): stderr: | 20221213092745582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092745582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092745582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092745582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092745583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092745583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092745583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:47.377320 run osmo-stp_10.42.42.5(pid=32245): stdout: | (launched: 2022-12-13_09:27:45.409861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:47.505028 run osmo-stp_10.42.42.5(pid=32245): stderr: | 20221213092745582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092745582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092745582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092745582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092745583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092745583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092745583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:47.657380 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32245): Process ended prematurely: osmo-stp_10.42.42.5(pid=32245) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32245)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:27:47.667083 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:27:47.695291 run osmo-hlr_10.42.42.2(pid=32242): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32242)] 09:27:47.745668 run osmo-hlr_10.42.42.2(pid=32242): stdout: | (launched: 2022-12-13_09:27:44.439994) 09:27:47.797912 run osmo-hlr_10.42.42.2(pid=32242): stderr: | 20221213092744638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092744638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092744638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092744638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092744638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092744638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092744651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092744660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092744660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092744660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:47.870491 run osmo-msc_10.42.42.6(pid=32248): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32248)] 09:27:47.920459 run osmo-msc_10.42.42.6(pid=32248): stdout: | (launched: 2022-12-13_09:27:46.439787) 09:27:47.973086 run osmo-msc_10.42.42.6(pid=32248): stderr: | 20221213092747003 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092747003 DLGLOBAL DEBUG validating counter group 0x7f227e5c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092747003 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092747003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092747003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092747004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092747010 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092747010 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092747010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092747010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:48.025241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32241): Terminating (SIGTERM) 09:27:48.067159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32244): Terminating (SIGTERM) 09:27:48.109438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32247): Terminating (SIGTERM) 09:27:48.151340 --- ParallelTerminationStrategy: PID 32241 died... 09:27:48.171390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32241): Terminated: ok {rc=0} 09:27:48.217624 --- ParallelTerminationStrategy: PID 32244 died... 09:27:48.237225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32244): Terminated: ok {rc=0} 09:27:48.282893 --- ParallelTerminationStrategy: PID 32247 died... 09:27:48.302557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32247): Terminated: ok {rc=0} 09:27:48.390123 bus /sierra_3: Setting Powered False 09:27:49.486071 bus /sierra_3: Setting Powered False 09:27:50.600390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:27:51.854446 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:51.860641 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:27:51.901143 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:27:51.941161 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:27:51.993281 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:27:52.023152 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:27:52.050193 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:27:52.602832 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:27:52.653926 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:27:52.665619 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:27:52.733261 tst mo_mt_call.py: using LAC 33026 09:27:52.858448 tst mo_mt_call.py: using RAC 131 09:27:52.985020 tst mo_mt_call.py: using CellId 33026 09:27:53.109464 tst mo_mt_call.py: using BVCI 33027 09:27:53.218994 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:27:53.230219 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:27:53.241212 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:27:53.252015 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:27:53.263920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:27:53.275784 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:27:53.396538 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:27:53.511809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:53.972299 run create_hlr_db(pid=32253): Launched 09:27:54.085731 bus /sierra_2: Setting Powered False 09:27:55.145321 run create_hlr_db(pid=32253): Terminated: ok {rc=0} 09:27:55.559871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32255): Launched 09:27:55.857482 run osmo-hlr_10.42.42.2(pid=32256): Launched 09:27:55.970819 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:56.500776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32258): Launched 09:27:56.798266 run osmo-stp_10.42.42.5(pid=32259): Launched 09:27:56.912762 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:57.451762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32261): Launched 09:27:57.749733 run osmo-msc_10.42.42.6(pid=32262): Launched 09:27:57.917186 run osmo-stp_10.42.42.5(pid=32259): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32259)] 09:27:58.052303 run osmo-stp_10.42.42.5(pid=32259): stdout: | (launched: 2022-12-13_09:27:56.743161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:58.189804 run osmo-stp_10.42.42.5(pid=32259): stderr: | 20221213092756912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092756912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092756912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092756913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092756915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092756915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092756915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:58.323012 run osmo-stp_10.42.42.5(pid=32259): stdout: | (launched: 2022-12-13_09:27:56.743161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:58.451537 run osmo-stp_10.42.42.5(pid=32259): stderr: | 20221213092756912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092756912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092756912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092756913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092756915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092756915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092756915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:58.604256 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32259): Process ended prematurely: osmo-stp_10.42.42.5(pid=32259) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32259)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:27:58.614020 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:27:58.642189 run osmo-hlr_10.42.42.2(pid=32256): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32256)] 09:27:58.692932 run osmo-hlr_10.42.42.2(pid=32256): stdout: | (launched: 2022-12-13_09:27:55.802949) 09:27:58.744508 run osmo-hlr_10.42.42.2(pid=32256): stderr: | 20221213092755976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092755976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092755977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092755977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092755977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092755977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092755990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092755998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092755999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092755999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:58.817076 run osmo-msc_10.42.42.6(pid=32262): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32262)] 09:27:58.866751 run osmo-msc_10.42.42.6(pid=32262): stdout: | (launched: 2022-12-13_09:27:57.695008) 09:27:58.918116 run osmo-msc_10.42.42.6(pid=32262): stderr: | 20221213092757967 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092757967 DLGLOBAL DEBUG validating counter group 0x7f81c7c81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092757967 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092757967 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092757967 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092757967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092757971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092757971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092757971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092757971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:58.969983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32255): Terminating (SIGTERM) 09:27:59.011612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32258): Terminating (SIGTERM) 09:27:59.053707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32261): Terminating (SIGTERM) 09:27:59.096358 --- ParallelTerminationStrategy: PID 32255 died... 09:27:59.116571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32255): Terminated: ok {rc=0} 09:27:59.162591 --- ParallelTerminationStrategy: PID 32258 died... 09:27:59.182387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32258): Terminated: ok {rc=0} 09:27:59.228338 --- ParallelTerminationStrategy: PID 32261 died... 09:27:59.248044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32261): Terminated: ok {rc=0} 09:27:59.336517 bus /sierra_3: Setting Powered False 09:28:00.434733 bus /sierra_3: Setting Powered False 09:28:01.558157 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:28:02.720818 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:28:02.733156 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:28:02.802283 tst mo_mt_call_osmux.py: using LAC 33027 09:28:02.929628 tst mo_mt_call_osmux.py: using RAC 132 09:28:03.054599 tst mo_mt_call_osmux.py: using CellId 33027 09:28:03.179063 tst mo_mt_call_osmux.py: using BVCI 33028 09:28:03.294678 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:28:03.306556 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:28:03.318021 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:28:03.329444 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:28:03.340873 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:28:03.352320 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:28:03.469834 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:28:03.589440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:04.083708 run create_hlr_db(pid=32264): Launched 09:28:04.213790 bus /sierra_2: Setting Powered False 09:28:05.277147 run create_hlr_db(pid=32264): Terminated: ok {rc=0} 09:28:05.720301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32266): Launched 09:28:06.039424 run osmo-hlr_10.42.42.2(pid=32267): Launched 09:28:06.160719 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:06.708690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32269): Launched 09:28:07.006806 run osmo-stp_10.42.42.5(pid=32270): Launched 09:28:07.120201 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:07.657332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32272): Launched 09:28:07.955703 run osmo-msc_10.42.42.6(pid=32273): Launched 09:28:08.122929 run osmo-stp_10.42.42.5(pid=32270): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32270)] 09:28:08.250271 run osmo-stp_10.42.42.5(pid=32270): stdout: | (launched: 2022-12-13_09:28:06.952089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:08.376691 run osmo-stp_10.42.42.5(pid=32270): stderr: | 20221213092807125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092807126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092807126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092807126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092807127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092807127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092807127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:08.501791 run osmo-stp_10.42.42.5(pid=32270): stdout: | (launched: 2022-12-13_09:28:06.952089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:08.620711 run osmo-stp_10.42.42.5(pid=32270): stderr: | 20221213092807125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092807126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092807126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092807126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092807127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092807127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092807127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:08.763197 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32270): Process ended prematurely: osmo-stp_10.42.42.5(pid=32270) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32270)] [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:28:08.772231 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:28:08.798665 run osmo-hlr_10.42.42.2(pid=32267): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32267)] 09:28:08.846872 run osmo-hlr_10.42.42.2(pid=32267): stdout: | (launched: 2022-12-13_09:28:05.981469) 09:28:08.896277 run osmo-hlr_10.42.42.2(pid=32267): stderr: | 20221213092806181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092806181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092806181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092806181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092806181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092806181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092806194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092806204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092806205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092806205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:08.965786 run osmo-msc_10.42.42.6(pid=32273): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32273)] 09:28:09.013079 run osmo-msc_10.42.42.6(pid=32273): stdout: | (launched: 2022-12-13_09:28:07.901084) 09:28:09.062402 run osmo-msc_10.42.42.6(pid=32273): stderr: | 20221213092808175 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092808175 DLGLOBAL DEBUG validating counter group 0x7fdd3409bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092808175 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092808175 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092808175 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092808176 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092808177 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092808178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092808178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092808178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:09.112125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32266): Terminating (SIGTERM) 09:28:09.151897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32269): Terminating (SIGTERM) 09:28:09.191907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32272): Terminating (SIGTERM) 09:28:09.232313 --- ParallelTerminationStrategy: PID 32266 died... 09:28:09.251812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32266): Terminated: ok {rc=0} 09:28:09.296330 --- ParallelTerminationStrategy: PID 32269 died... 09:28:09.315672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32269): Terminated: ok {rc=0} 09:28:09.359895 --- ParallelTerminationStrategy: PID 32272 died... 09:28:09.379285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32272): Terminated: ok {rc=0} 09:28:09.463215 bus /sierra_3: Setting Powered False 09:28:10.560406 bus /sierra_3: Setting Powered False 09:28:11.678628 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 09:28:12.919363 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:28:12.923726 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:28:12.952422 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:28:12.980170 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:28:13.063204 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:28:13.091501 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:28:13.118552 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:28:13.701802 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 09:28:13.706743 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:13.717708 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:28:13.762742 tst emergency_mo_mt_call.py: using LAC 33028 09:28:13.879515 tst emergency_mo_mt_call.py: using RAC 133 09:28:13.993778 tst emergency_mo_mt_call.py: using CellId 33028 09:28:14.108348 tst emergency_mo_mt_call.py: using BVCI 33029 09:28:14.213878 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:14.224675 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:14.235360 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:14.245971 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:14.256755 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:14.267561 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:14.386335 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:14.503793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:14.990972 run create_hlr_db(pid=32278): Launched 09:28:15.118616 bus /sierra_2: Setting Powered False 09:28:16.179671 run create_hlr_db(pid=32278): Terminated: ok {rc=0} 09:28:16.703058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32280): Launched 09:28:17.031071 run osmo-hlr_10.42.42.2(pid=32281): Launched 09:28:17.250368 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:17.811135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32283): Launched 09:28:18.123272 run osmo-stp_10.42.42.5(pid=32284): Launched 09:28:18.252774 tst emergency_mo_mt_call.py: using MSISDN 8082 09:28:18.412864 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:18.979852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32286): Launched 09:28:19.292428 run osmo-msc_10.42.42.6(pid=32287): Launched 09:28:19.467217 run osmo-stp_10.42.42.5(pid=32284): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32284)] 09:28:19.599344 run osmo-stp_10.42.42.5(pid=32284): stdout: | (launched: 2022-12-13_09:28:18.066305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:19.731412 run osmo-stp_10.42.42.5(pid=32284): stderr: | 20221213092818258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092818258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092818258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092818259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092818259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092818259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092818259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:19.864583 run osmo-stp_10.42.42.5(pid=32284): stdout: | (launched: 2022-12-13_09:28:18.066305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:19.989025 run osmo-stp_10.42.42.5(pid=32284): stderr: | 20221213092818258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092818258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092818258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092818259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092818259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092818259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092818259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:20.138146 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32284): Process ended prematurely: osmo-stp_10.42.42.5(pid=32284) [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32284)] [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 09:28:20.147049 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 09:28:20.174383 run osmo-hlr_10.42.42.2(pid=32281): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32281)] 09:28:20.224242 run osmo-hlr_10.42.42.2(pid=32281): stdout: | (launched: 2022-12-13_09:28:16.966862) 09:28:20.275732 run osmo-hlr_10.42.42.2(pid=32281): stderr: | 20221213092817187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092817187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092817187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092817188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092817188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092817188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092817220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092817235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092817236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092817236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:20.347070 run osmo-msc_10.42.42.6(pid=32287): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32287)] 09:28:20.396243 run osmo-msc_10.42.42.6(pid=32287): stdout: | (launched: 2022-12-13_09:28:19.235303) 09:28:20.447187 run osmo-msc_10.42.42.6(pid=32287): stderr: | 20221213092819560 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092819560 DLGLOBAL DEBUG validating counter group 0x7f4acbfb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092819560 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092819560 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092819561 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092819561 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092819563 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092819563 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092819563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092819563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:20.498653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32280): Terminating (SIGTERM) 09:28:20.539756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32283): Terminating (SIGTERM) 09:28:20.581116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32286): Terminating (SIGTERM) 09:28:20.623207 --- ParallelTerminationStrategy: PID 32280 died... 09:28:20.643225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32280): Terminated: ok {rc=0} 09:28:20.688727 --- ParallelTerminationStrategy: PID 32283 died... 09:28:20.708193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32283): Terminated: ok {rc=0} 09:28:20.753734 --- ParallelTerminationStrategy: PID 32286 died... 09:28:20.773609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32286): Terminated: ok {rc=0} 09:28:20.859827 bus /sierra_3: Setting Powered False 09:28:21.953636 bus /sierra_3: Setting Powered False 09:28:23.066546 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 09:28:24.152460 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:24.163953 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:28:24.210711 tst emergency_preemptive_call.py: using LAC 33029 09:28:24.327464 tst emergency_preemptive_call.py: using RAC 134 09:28:24.442185 tst emergency_preemptive_call.py: using CellId 33029 09:28:24.568438 tst emergency_preemptive_call.py: using BVCI 33030 09:28:24.683705 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:24.695356 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:24.706459 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:24.717963 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:24.729588 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:28:24.741093 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:24.859836 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:24.980047 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:25.097303 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:25.214099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:25.699668 run create_hlr_db(pid=32289): Launched 09:28:25.826491 bus /sierra_2: Setting Powered False 09:28:26.889289 run create_hlr_db(pid=32289): Terminated: ok {rc=0} 09:28:27.305754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32291): Launched 09:28:27.598974 run osmo-hlr_10.42.42.2(pid=32292): Launched 09:28:27.710946 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:28.225706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32294): Launched 09:28:28.517468 run osmo-stp_10.42.42.5(pid=32295): Launched 09:28:28.638083 tst emergency_preemptive_call.py: using MSISDN 8083 09:28:28.787130 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:29.311595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32297): Launched 09:28:29.602199 run osmo-msc_10.42.42.6(pid=32298): Launched 09:28:29.765728 run osmo-stp_10.42.42.5(pid=32295): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32295)] 09:28:29.890457 run osmo-stp_10.42.42.5(pid=32295): stdout: | (launched: 2022-12-13_09:28:28.463742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:30.016239 run osmo-stp_10.42.42.5(pid=32295): stderr: | 20221213092828634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092828634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092828635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092828635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092828636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092828636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092828636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:30.138944 run osmo-stp_10.42.42.5(pid=32295): stdout: | (launched: 2022-12-13_09:28:28.463742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:30.255618 run osmo-stp_10.42.42.5(pid=32295): stderr: | 20221213092828634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092828634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092828635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092828635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092828636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092828636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092828636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:30.395665 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32295): Process ended prematurely: osmo-stp_10.42.42.5(pid=32295) [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32295)] [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 09:28:30.403982 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 09:28:30.430112 run osmo-hlr_10.42.42.2(pid=32292): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32292)] 09:28:30.478415 run osmo-hlr_10.42.42.2(pid=32292): stdout: | (launched: 2022-12-13_09:28:27.545167) 09:28:30.527758 run osmo-hlr_10.42.42.2(pid=32292): stderr: | 20221213092827718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092827718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092827718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092827718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092827718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092827718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092827730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092827741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092827741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092827741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:30.597155 run osmo-msc_10.42.42.6(pid=32298): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32298)] 09:28:30.644297 run osmo-msc_10.42.42.6(pid=32298): stdout: | (launched: 2022-12-13_09:28:29.548753) 09:28:30.693546 run osmo-msc_10.42.42.6(pid=32298): stderr: | 20221213092829819 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213092829819 DLGLOBAL DEBUG validating counter group 0x7fba55eb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213092829819 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213092829819 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213092829819 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213092829819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213092829821 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213092829822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213092829822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213092829822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:30.743004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32291): Terminating (SIGTERM) 09:28:30.782591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32294): Terminating (SIGTERM) 09:28:30.825962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32297): Terminating (SIGTERM) 09:28:30.871849 --- ParallelTerminationStrategy: PID 32291 died... 09:28:30.893971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32291): Terminated: ok {rc=0} 09:28:30.943878 --- ParallelTerminationStrategy: PID 32294 died... 09:28:30.965184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32294): Terminated: ok {rc=0} 09:28:31.013241 --- ParallelTerminationStrategy: PID 32297 died... 09:28:31.036216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32297): Terminated: ok {rc=0} 09:28:31.129868 bus /sierra_9: Setting Powered False 09:28:32.236901 bus /sierra_9: Setting Powered False 09:28:33.352462 bus /sierra_8: Setting Powered False 09:28:34.448939 bus /sierra_8: Setting Powered False 09:28:35.562324 bus /sierra_3: Setting Powered False 09:28:36.661198 bus /sierra_3: Setting Powered False 09:28:37.779016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 09:28:39.051792 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:28:39.057514 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:28:39.088471 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 09:28:39.127721 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:28:39.214775 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:28:39.244502 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 09:28:39.283791 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:28:39.879879 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 09:28:39.931798 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:39.942998 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:28:39.986995 tst cs_paging_gprs_active.py: using LAC 33030 09:28:40.112394 tst cs_paging_gprs_active.py: using RAC 135 09:28:40.236091 tst cs_paging_gprs_active.py: using CellId 33030 09:28:40.359878 tst cs_paging_gprs_active.py: using BVCI 33031 09:28:40.477238 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.488472 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.499596 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.510645 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.521599 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.532595 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.543751 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.554754 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:40.565850 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:40.683287 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:40.802984 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:28:41.004003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:41.304297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32305): Launched 09:28:41.564360 run iperf3-srv_10.42.42.10(pid=32306): Launched 09:28:41.676577 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:28:41.876234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:42.176154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32307): Launched 09:28:42.436450 run iperf3-srv_10.42.42.10(pid=32308): Launched 09:28:42.548468 tst cs_paging_gprs_active.py:38: start network... 09:28:42.749069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:43.211339 run create_hlr_db(pid=32309): Launched 09:28:43.325791 bus /sierra_2: Setting Powered False 09:28:44.386276 run create_hlr_db(pid=32309): Terminated: ok {rc=0} 09:28:44.822546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32311): Launched 09:28:45.141654 run osmo-hlr_10.42.42.2(pid=32312): Launched 09:28:45.264210 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:45.818273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32314): Launched 09:28:46.175268 run osmo-stp_10.42.42.5(pid=32315): Launched 09:28:46.296431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:47.023576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32317): Launched 09:28:47.156688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:28:47.427967 run patchelf(pid=32318): Launched 09:28:47.605716 run osmo-stp_10.42.42.5(pid=32315): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32315)] 09:28:47.740876 run osmo-stp_10.42.42.5(pid=32315): stdout: | (launched: 2022-12-13_09:28:46.109359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:47.878447 run osmo-stp_10.42.42.5(pid=32315): stderr: | 20221213092846459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092846459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092846460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092846460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092846473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092846473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092846473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:48.015347 run osmo-stp_10.42.42.5(pid=32315): stdout: | (launched: 2022-12-13_09:28:46.109359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:48.146629 run osmo-stp_10.42.42.5(pid=32315): stderr: | 20221213092846459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092846459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092846460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092846460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092846473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092846473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092846473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:48.301626 run patchelf(pid=32318): Terminating (SIGINT) 09:28:48.481029 run patchelf(pid=32318): Terminated: ok {rc=0} 09:28:48.609799 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32315): Process ended prematurely: osmo-stp_10.42.42.5(pid=32315) [trial-2387↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32315)] [trial-2387↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 09:28:48.619978 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:28:48.648541 run osmo-hlr_10.42.42.2(pid=32312): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32312)] 09:28:48.697961 run osmo-hlr_10.42.42.2(pid=32312): stdout: | (launched: 2022-12-13_09:28:45.083432) 09:28:48.748899 run osmo-hlr_10.42.42.2(pid=32312): stderr: | 20221213092845279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092845279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092845279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092845279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092845279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092845279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092845291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092845299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092845299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092845300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:48.801441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32305): Terminating (SIGTERM) 09:28:48.842875 run iperf3-srv_10.42.42.10(pid=32306): Terminating (SIGTERM) 09:28:48.884068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32307): Terminating (SIGTERM) 09:28:48.925439 run iperf3-srv_10.42.42.10(pid=32308): Terminating (SIGTERM) 09:28:48.966549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32311): Terminating (SIGTERM) 09:28:49.007806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32314): Terminating (SIGTERM) 09:28:49.049064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32317): Terminating (SIGTERM) 09:28:49.090595 --- ParallelTerminationStrategy: PID 32305 died... 09:28:49.110401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32305): Terminated: ok {rc=0} 09:28:49.156354 --- ParallelTerminationStrategy: PID 32306 died... 09:28:49.175541 run iperf3-srv_10.42.42.10(pid=32306): Terminated {rc=256} 09:28:49.221344 --- ParallelTerminationStrategy: PID 32307 died... 09:28:49.240580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32307): Terminated: ok {rc=0} 09:28:49.286209 --- ParallelTerminationStrategy: PID 32308 died... 09:28:49.305518 run iperf3-srv_10.42.42.10(pid=32308): Terminated {rc=256} 09:28:49.350899 --- ParallelTerminationStrategy: PID 32311 died... 09:28:49.370271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32311): Terminated: ok {rc=0} 09:28:49.415604 --- ParallelTerminationStrategy: PID 32314 died... 09:28:49.435006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32314): Terminated: ok {rc=0} 09:28:49.480709 --- ParallelTerminationStrategy: PID 32317 died... 09:28:49.500157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32317): Terminated: ok {rc=0} 09:28:49.586061 bus /gobi_0: Setting Powered False 09:28:50.682973 bus /gobi_0: Setting Powered False 09:28:51.797156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 09:28:52.944338 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:52.956074 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:28:53.003940 tst iperf3.py: using LAC 33031 09:28:53.129079 tst iperf3.py: using RAC 136 09:28:53.253149 tst iperf3.py: using CellId 33031 09:28:53.377765 tst iperf3.py: using BVCI 33032 09:28:53.493283 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.504495 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.515545 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.526525 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.537476 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.548594 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.559803 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.570807 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:28:53.581924 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:28:53.700479 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:28:53.916448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:54.236445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32319): Launched 09:28:54.514336 run iperf3-srv_10.42.42.10(pid=32320): Launched 09:28:54.633659 tst iperf3.py:8: start network... 09:28:54.847515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:55.308587 run create_hlr_db(pid=32321): Launched 09:28:55.423438 bus /gobi_6: Setting Powered False 09:28:56.483095 run create_hlr_db(pid=32321): Terminated: ok {rc=0} 09:28:56.897525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32323): Launched 09:28:57.194496 run osmo-hlr_10.42.42.2(pid=32324): Launched 09:28:57.308152 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:57.835104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32326): Launched 09:28:58.132304 run osmo-stp_10.42.42.5(pid=32327): Launched 09:28:58.246335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:58.760158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32329): Launched 09:28:58.874299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:28:59.126616 run patchelf(pid=32330): Launched 09:28:59.292121 run osmo-stp_10.42.42.5(pid=32327): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32327)] 09:28:59.418837 run osmo-stp_10.42.42.5(pid=32327): stdout: | (launched: 2022-12-13_09:28:58.077756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:59.546840 run osmo-stp_10.42.42.5(pid=32327): stderr: | 20221213092858247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092858247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092858247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092858248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092858248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092858248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092858248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:59.675009 run osmo-stp_10.42.42.5(pid=32327): stdout: | (launched: 2022-12-13_09:28:58.077756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:59.797465 run osmo-stp_10.42.42.5(pid=32327): stderr: | 20221213092858247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092858247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092858247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092858248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092858248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092858248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092858248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:59.942391 run patchelf(pid=32330): Terminating (SIGINT) 09:29:00.110435 run patchelf(pid=32330): Terminated: ok {rc=0} 09:29:00.231752 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32327): Process ended prematurely: osmo-stp_10.42.42.5(pid=32327) [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32327)] [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 09:29:00.241267 tst iperf3.py:8: Test FAILED (7.3 sec) 09:29:00.268215 run osmo-hlr_10.42.42.2(pid=32324): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32324)] 09:29:00.316020 run osmo-hlr_10.42.42.2(pid=32324): stdout: | (launched: 2022-12-13_09:28:57.139939) 09:29:00.364863 run osmo-hlr_10.42.42.2(pid=32324): stderr: | 20221213092857314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092857314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092857314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092857314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092857315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092857315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092857331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092857339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092857339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092857339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:00.414259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32319): Terminating (SIGTERM) 09:29:00.453871 run iperf3-srv_10.42.42.10(pid=32320): Terminating (SIGTERM) 09:29:00.493340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32323): Terminating (SIGTERM) 09:29:00.533042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32326): Terminating (SIGTERM) 09:29:00.572469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32329): Terminating (SIGTERM) 09:29:00.612277 --- ParallelTerminationStrategy: PID 32319 died... 09:29:00.631428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32319): Terminated: ok {rc=0} 09:29:00.675594 --- ParallelTerminationStrategy: PID 32320 died... 09:29:00.694441 run iperf3-srv_10.42.42.10(pid=32320): Terminated {rc=256} 09:29:00.738279 --- ParallelTerminationStrategy: PID 32323 died... 09:29:00.757225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32323): Terminated: ok {rc=0} 09:29:00.801194 --- ParallelTerminationStrategy: PID 32326 died... 09:29:00.820451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32326): Terminated: ok {rc=0} 09:29:00.878192 --- ParallelTerminationStrategy: PID 32329 died... 09:29:00.901672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32329): Terminated: ok {rc=0} 09:29:00.988102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 09:29:02.159698 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.173102 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:29:02.228047 tst iperf3m4.py: using LAC 33032 09:29:02.362296 tst iperf3m4.py: using RAC 137 09:29:02.479079 tst iperf3m4.py: using CellId 33032 09:29:02.594569 tst iperf3m4.py: using BVCI 33033 09:29:02.704309 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.715152 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.725798 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.736281 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.747205 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.757964 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.768886 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.779623 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:02.790531 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:29:02.909620 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:29:03.026995 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:29:03.147649 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:29:03.271148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:29:03.486817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:03.807641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32331): Launched 09:29:04.084838 run iperf3-srv_10.42.42.10(pid=32332): Launched 09:29:04.204817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:29:04.420881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:04.741517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32333): Launched 09:29:05.019552 run iperf3-srv_10.42.42.10(pid=32334): Launched 09:29:05.139160 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:29:05.354310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:05.674091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32335): Launched 09:29:05.951470 run iperf3-srv_10.42.42.10(pid=32336): Launched 09:29:06.071194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:29:06.286332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:06.606360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32337): Launched 09:29:06.884352 run iperf3-srv_10.42.42.10(pid=32338): Launched 09:29:07.004870 tst iperf3m4.py:8: start network... 09:29:07.220216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:07.718306 run create_hlr_db(pid=32339): Launched 09:29:07.847616 bus /gobi_6: Setting Powered False 09:29:08.910518 run create_hlr_db(pid=32339): Terminated: ok {rc=0} 09:29:09.354446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32341): Launched 09:29:09.673594 run osmo-hlr_10.42.42.2(pid=32342): Launched 09:29:09.795406 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:10.447713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32344): Launched 09:29:10.760228 run osmo-stp_10.42.42.5(pid=32345): Launched 09:29:10.880069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:11.420872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32347): Launched 09:29:11.539858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:11.803952 run patchelf(pid=32348): Launched 09:29:11.978191 run osmo-stp_10.42.42.5(pid=32345): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32345)] 09:29:12.110903 run osmo-stp_10.42.42.5(pid=32345): stdout: | (launched: 2022-12-13_09:29:10.702957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:12.244729 run osmo-stp_10.42.42.5(pid=32345): stderr: | 20221213092910894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092910895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092910895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092910895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092910896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092910896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092910896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:12.378476 run osmo-stp_10.42.42.5(pid=32345): stdout: | (launched: 2022-12-13_09:29:10.702957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:12.506767 run osmo-stp_10.42.42.5(pid=32345): stderr: | 20221213092910894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092910895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092910895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092910895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092910896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092910896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092910896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:12.658940 run patchelf(pid=32348): Terminating (SIGINT) 09:29:12.834891 run patchelf(pid=32348): Terminated: ok {rc=0} 09:29:12.962004 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32345): Process ended prematurely: osmo-stp_10.42.42.5(pid=32345) [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32345)] [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 09:29:12.972169 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:29:13.000683 run osmo-hlr_10.42.42.2(pid=32342): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32342)] 09:29:13.049945 run osmo-hlr_10.42.42.2(pid=32342): stdout: | (launched: 2022-12-13_09:29:09.615311) 09:29:13.101393 run osmo-hlr_10.42.42.2(pid=32342): stderr: | 20221213092909816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092909816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092909816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092909816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092909816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092909816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092909828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092909836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092909837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092909837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:13.152751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32331): Terminating (SIGTERM) 09:29:13.194000 run iperf3-srv_10.42.42.10(pid=32332): Terminating (SIGTERM) 09:29:13.234971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32333): Terminating (SIGTERM) 09:29:13.276106 run iperf3-srv_10.42.42.10(pid=32334): Terminating (SIGTERM) 09:29:13.317205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32335): Terminating (SIGTERM) 09:29:13.358548 run iperf3-srv_10.42.42.10(pid=32336): Terminating (SIGTERM) 09:29:13.399546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32337): Terminating (SIGTERM) 09:29:13.440568 run iperf3-srv_10.42.42.10(pid=32338): Terminating (SIGTERM) 09:29:13.481622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32341): Terminating (SIGTERM) 09:29:13.522670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32344): Terminating (SIGTERM) 09:29:13.563758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32347): Terminating (SIGTERM) 09:29:13.605181 --- ParallelTerminationStrategy: PID 32331 died... 09:29:13.624918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32331): Terminated: ok {rc=0} 09:29:13.670461 --- ParallelTerminationStrategy: PID 32332 died... 09:29:13.689847 run iperf3-srv_10.42.42.10(pid=32332): Terminated {rc=256} 09:29:13.735201 --- ParallelTerminationStrategy: PID 32333 died... 09:29:13.754477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32333): Terminated: ok {rc=0} 09:29:13.800093 --- ParallelTerminationStrategy: PID 32334 died... 09:29:13.819308 run iperf3-srv_10.42.42.10(pid=32334): Terminated {rc=256} 09:29:13.864733 --- ParallelTerminationStrategy: PID 32335 died... 09:29:13.884035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32335): Terminated: ok {rc=0} 09:29:13.929357 --- ParallelTerminationStrategy: PID 32336 died... 09:29:13.948601 run iperf3-srv_10.42.42.10(pid=32336): Terminated {rc=256} 09:29:13.993819 --- ParallelTerminationStrategy: PID 32337 died... 09:29:14.013150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32337): Terminated: ok {rc=0} 09:29:14.058467 --- ParallelTerminationStrategy: PID 32338 died... 09:29:14.077807 run iperf3-srv_10.42.42.10(pid=32338): Terminated {rc=256} 09:29:14.123162 --- ParallelTerminationStrategy: PID 32341 died... 09:29:14.142549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32341): Terminated: ok {rc=0} 09:29:14.187661 --- ParallelTerminationStrategy: PID 32344 died... 09:29:14.206856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32344): Terminated: ok {rc=0} 09:29:14.252600 --- ParallelTerminationStrategy: PID 32347 died... 09:29:14.271916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32347): Terminated: ok {rc=0} 09:29:14.357485 bus /gobi_4: Setting Powered False 09:29:15.454886 bus /gobi_4: Setting Powered False 09:29:16.568752 bus /gobi_1: Setting Powered False 09:29:17.666452 bus /gobi_1: Setting Powered False 09:29:18.781785 bus /gobi_0: Setting Powered False 09:29:19.879503 bus /gobi_0: Setting Powered False 09:29:20.996595 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 09:29:22.100493 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.112093 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:29:22.159442 tst ping.py: using LAC 33033 09:29:22.272844 tst ping.py: using RAC 138 09:29:22.385565 tst ping.py: using CellId 33033 09:29:22.508359 tst ping.py: using BVCI 33034 09:29:22.620580 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.631712 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.642941 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.653947 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.665415 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.676806 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.688428 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:22.699855 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:29:22.812569 tst ping.py:19: start network... 09:29:23.005253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:23.450670 run create_hlr_db(pid=32349): Launched 09:29:23.560887 bus /gobi_6: Setting Powered False 09:29:24.619363 run create_hlr_db(pid=32349): Terminated: ok {rc=0} 09:29:25.042061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32351): Launched 09:29:25.351353 run osmo-hlr_10.42.42.2(pid=32352): Launched 09:29:25.468892 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:26.004264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32354): Launched 09:29:26.313501 run osmo-stp_10.42.42.5(pid=32355): Launched 09:29:26.431315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:26.967664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32357): Launched 09:29:27.085451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:27.346781 run patchelf(pid=32358): Launched 09:29:27.517576 run osmo-stp_10.42.42.5(pid=32355): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32355)] 09:29:27.648374 run osmo-stp_10.42.42.5(pid=32355): stdout: | (launched: 2022-12-13_09:29:26.256537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:27.780749 run osmo-stp_10.42.42.5(pid=32355): stderr: | 20221213092926446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092926446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092926446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092926447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092926447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092926447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092926447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:27.913610 run osmo-stp_10.42.42.5(pid=32355): stdout: | (launched: 2022-12-13_09:29:26.256537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:28.040449 run osmo-stp_10.42.42.5(pid=32355): stderr: | 20221213092926446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092926446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092926446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092926447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092926447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092926447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092926447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:28.190886 run patchelf(pid=32358): Terminating (SIGINT) 09:29:28.363445 run patchelf(pid=32358): Terminated: ok {rc=0} 09:29:28.488025 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32355): Process ended prematurely: osmo-stp_10.42.42.5(pid=32355) [trial-2387↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32355)] [trial-2387↪gprs:trx-lms-limenet-micro↪ping.py:22] 09:29:28.497531 tst ping.py:22: Test FAILED (6.4 sec) 09:29:28.524693 run osmo-hlr_10.42.42.2(pid=32352): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32352)] 09:29:28.574201 run osmo-hlr_10.42.42.2(pid=32352): stdout: | (launched: 2022-12-13_09:29:25.295263) 09:29:28.625343 run osmo-hlr_10.42.42.2(pid=32352): stderr: | 20221213092925489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092925489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092925489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092925489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092925489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092925490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092925502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092925511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092925511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092925512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:28.676611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32351): Terminating (SIGTERM) 09:29:28.717848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32354): Terminating (SIGTERM) 09:29:28.759016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32357): Terminating (SIGTERM) 09:29:28.800465 --- ParallelTerminationStrategy: PID 32351 died... 09:29:28.820532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32351): Terminated: ok {rc=0} 09:29:28.866202 --- ParallelTerminationStrategy: PID 32354 died... 09:29:28.885462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32354): Terminated: ok {rc=0} 09:29:28.930800 --- ParallelTerminationStrategy: PID 32357 died... 09:29:28.950024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32357): Terminated: ok {rc=0} 09:29:29.035704 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 09:29:30.120477 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.131852 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:29:30.180034 tst ping_idle_ping.py: using LAC 33034 09:29:30.293695 tst ping_idle_ping.py: using RAC 139 09:29:30.412398 tst ping_idle_ping.py: using CellId 33034 09:29:30.526733 tst ping_idle_ping.py: using BVCI 33035 09:29:30.631902 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.642771 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.653569 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.664222 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.675117 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.686143 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.697308 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:29:30.708175 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:29:30.834635 tst ping_idle_ping.py:24: start network... 09:29:31.044000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:31.539509 run create_hlr_db(pid=32359): Launched 09:29:31.685768 bus /gobi_6: Setting Powered False 09:29:32.743252 run create_hlr_db(pid=32359): Terminated: ok {rc=0} 09:29:33.149603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32361): Launched 09:29:33.439782 run osmo-hlr_10.42.42.2(pid=32362): Launched 09:29:33.550910 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:34.066817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32364): Launched 09:29:34.356905 run osmo-stp_10.42.42.5(pid=32365): Launched 09:29:34.468076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:34.970030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32367): Launched 09:29:35.081662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:35.340941 run patchelf(pid=32368): Launched 09:29:35.513042 run osmo-stp_10.42.42.5(pid=32365): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32365)] 09:29:35.644677 run osmo-stp_10.42.42.5(pid=32365): stdout: | (launched: 2022-12-13_09:29:34.303727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:35.777891 run osmo-stp_10.42.42.5(pid=32365): stderr: | 20221213092934470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092934470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092934471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092934471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092934471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092934472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092934472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:35.911081 run osmo-stp_10.42.42.5(pid=32365): stdout: | (launched: 2022-12-13_09:29:34.303727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:36.038361 run osmo-stp_10.42.42.5(pid=32365): stderr: | 20221213092934470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092934470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092934471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092934471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092934471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092934472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092934472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:36.189319 run patchelf(pid=32368): Terminating (SIGINT) 09:29:36.362663 run patchelf(pid=32368): Terminated: ok {rc=0} 09:29:36.487761 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32365): Process ended prematurely: osmo-stp_10.42.42.5(pid=32365) [trial-2387↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32365)] [trial-2387↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 09:29:36.497230 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:29:36.524449 run osmo-hlr_10.42.42.2(pid=32362): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32362)] 09:29:36.574340 run osmo-hlr_10.42.42.2(pid=32362): stdout: | (launched: 2022-12-13_09:29:33.386825) 09:29:36.625750 run osmo-hlr_10.42.42.2(pid=32362): stderr: | 20221213092933561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092933562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092933562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092933562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092933562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092933562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092933574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092933582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092933583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092933583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:36.677399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32361): Terminating (SIGTERM) 09:29:36.718578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32364): Terminating (SIGTERM) 09:29:36.759890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32367): Terminating (SIGTERM) 09:29:36.801893 --- ParallelTerminationStrategy: PID 32361 died... 09:29:36.821655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32361): Terminated: ok {rc=0} 09:29:36.867233 --- ParallelTerminationStrategy: PID 32364 died... 09:29:36.886564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32364): Terminated: ok {rc=0} 09:29:36.931999 --- ParallelTerminationStrategy: PID 32367 died... 09:29:36.951157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32367): Terminated: ok {rc=0} 09:29:37.037323 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 09:29:38.329196 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:38.334750 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:29:38.363491 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:29:38.402223 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:29:38.487365 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:29:38.515621 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:29:38.553482 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:29:39.148297 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:29:39.196428 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.207381 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:29:39.253352 tst cs_paging_gprs_active.py: using LAC 33035 09:29:39.368291 tst cs_paging_gprs_active.py: using RAC 140 09:29:39.484028 tst cs_paging_gprs_active.py: using CellId 33035 09:29:39.600479 tst cs_paging_gprs_active.py: using BVCI 33036 09:29:39.707177 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.718658 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.729428 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.739969 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.751051 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.762064 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.773161 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.784022 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:39.795061 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:29:39.914960 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:29:40.034554 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:29:40.247621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:40.564760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32372): Launched 09:29:40.839162 run iperf3-srv_10.42.42.10(pid=32373): Launched 09:29:40.957738 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:29:41.170555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:41.487691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32374): Launched 09:29:41.762629 run iperf3-srv_10.42.42.10(pid=32375): Launched 09:29:41.881484 tst cs_paging_gprs_active.py:38: start network... 09:29:42.093521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:42.583202 run create_hlr_db(pid=32376): Launched 09:29:42.699332 bus /gobi_6: Setting Powered False 09:29:43.758460 run create_hlr_db(pid=32376): Terminated: ok {rc=0} 09:29:44.170788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32378): Launched 09:29:44.465118 run osmo-hlr_10.42.42.2(pid=32379): Launched 09:29:44.579534 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:45.102772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32381): Launched 09:29:45.399041 run osmo-stp_10.42.42.5(pid=32382): Launched 09:29:45.512556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:46.077242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32384): Launched 09:29:46.235586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:46.513812 run patchelf(pid=32385): Launched 09:29:46.690335 run osmo-stp_10.42.42.5(pid=32382): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32382)] 09:29:46.822509 run osmo-stp_10.42.42.5(pid=32382): stdout: | (launched: 2022-12-13_09:29:45.345375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:46.955532 run osmo-stp_10.42.42.5(pid=32382): stderr: | 20221213092945514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092945514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092945514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092945514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092945517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092945517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092945517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:47.087743 run osmo-stp_10.42.42.5(pid=32382): stdout: | (launched: 2022-12-13_09:29:45.345375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:47.214217 run osmo-stp_10.42.42.5(pid=32382): stderr: | 20221213092945514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092945514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092945514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092945514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092945517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092945517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092945517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:47.358931 run patchelf(pid=32385): Terminating (SIGINT) 09:29:47.527139 run patchelf(pid=32385): Terminated: ok {rc=0} 09:29:47.648588 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32382): Process ended prematurely: osmo-stp_10.42.42.5(pid=32382) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32382)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:29:47.658614 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:29:47.685749 run osmo-hlr_10.42.42.2(pid=32379): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32379)] 09:29:47.734344 run osmo-hlr_10.42.42.2(pid=32379): stdout: | (launched: 2022-12-13_09:29:44.411548) 09:29:47.783715 run osmo-hlr_10.42.42.2(pid=32379): stderr: | 20221213092944587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092944587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092944587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092944587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092944587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092944587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092944599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092944608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092944608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092944608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:47.833890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32372): Terminating (SIGTERM) 09:29:47.873990 run iperf3-srv_10.42.42.10(pid=32373): Terminating (SIGTERM) 09:29:47.913886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32374): Terminating (SIGTERM) 09:29:47.953803 run iperf3-srv_10.42.42.10(pid=32375): Terminating (SIGTERM) 09:29:47.993661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32378): Terminating (SIGTERM) 09:29:48.033628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32381): Terminating (SIGTERM) 09:29:48.073653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32384): Terminating (SIGTERM) 09:29:48.114037 --- ParallelTerminationStrategy: PID 32372 died... 09:29:48.133398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32372): Terminated: ok {rc=0} 09:29:48.177746 --- ParallelTerminationStrategy: PID 32373 died... 09:29:48.196338 run iperf3-srv_10.42.42.10(pid=32373): Terminated {rc=256} 09:29:48.239984 --- ParallelTerminationStrategy: PID 32374 died... 09:29:48.258708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32374): Terminated: ok {rc=0} 09:29:48.302368 --- ParallelTerminationStrategy: PID 32375 died... 09:29:48.321143 run iperf3-srv_10.42.42.10(pid=32375): Terminated {rc=256} 09:29:48.364808 --- ParallelTerminationStrategy: PID 32378 died... 09:29:48.383994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32378): Terminated: ok {rc=0} 09:29:48.427860 --- ParallelTerminationStrategy: PID 32381 died... 09:29:48.446717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32381): Terminated: ok {rc=0} 09:29:48.490506 --- ParallelTerminationStrategy: PID 32384 died... 09:29:48.509407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32384): Terminated: ok {rc=0} 09:29:48.595027 bus /gobi_0: Setting Powered False 09:29:49.693684 bus /gobi_0: Setting Powered False 09:29:50.807013 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:29:51.950296 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:51.961702 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:29:52.011064 tst iperf3.py: using LAC 33036 09:29:52.127410 tst iperf3.py: using RAC 141 09:29:52.241425 tst iperf3.py: using CellId 33036 09:29:52.364774 tst iperf3.py: using BVCI 33037 09:29:52.479217 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.490906 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.502433 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.514107 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.525789 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.537381 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.548848 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.560165 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:52.571706 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:29:52.685422 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:29:52.884383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:53.180349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32386): Launched 09:29:53.437338 run iperf3-srv_10.42.42.10(pid=32387): Launched 09:29:53.548191 tst iperf3.py:8: start network... 09:29:53.746567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:54.203237 run create_hlr_db(pid=32388): Launched 09:29:54.319134 bus /gobi_6: Setting Powered False 09:29:55.378563 run create_hlr_db(pid=32388): Terminated: ok {rc=0} 09:29:55.809959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32390): Launched 09:29:56.125476 run osmo-hlr_10.42.42.2(pid=32391): Launched 09:29:56.246254 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:56.791862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32393): Launched 09:29:57.109312 run osmo-stp_10.42.42.5(pid=32394): Launched 09:29:57.223916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:57.733472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32396): Launched 09:29:57.855396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:58.122753 run patchelf(pid=32397): Launched 09:29:58.297867 run osmo-stp_10.42.42.5(pid=32394): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32394)] 09:29:58.431662 run osmo-stp_10.42.42.5(pid=32394): stdout: | (launched: 2022-12-13_09:29:57.051053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:58.566970 run osmo-stp_10.42.42.5(pid=32394): stderr: | 20221213092957220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092957220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092957221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092957221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092957221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092957222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092957222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:58.702354 run osmo-stp_10.42.42.5(pid=32394): stdout: | (launched: 2022-12-13_09:29:57.051053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:58.832572 run osmo-stp_10.42.42.5(pid=32394): stderr: | 20221213092957220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213092957220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213092957221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213092957221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213092957221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213092957222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213092957222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:58.986385 run patchelf(pid=32397): Terminating (SIGINT) 09:29:59.163609 run patchelf(pid=32397): Terminated: ok {rc=0} 09:29:59.291274 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32394): Process ended prematurely: osmo-stp_10.42.42.5(pid=32394) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32394)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 09:29:59.301263 tst iperf3.py:8: Test FAILED (7.4 sec) 09:29:59.329254 run osmo-hlr_10.42.42.2(pid=32391): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32391)] 09:29:59.379497 run osmo-hlr_10.42.42.2(pid=32391): stdout: | (launched: 2022-12-13_09:29:56.068147) 09:29:59.430533 run osmo-hlr_10.42.42.2(pid=32391): stderr: | 20221213092956266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213092956266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213092956266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213092956266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213092956266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213092956266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213092956279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213092956289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213092956289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213092956289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:59.482114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32386): Terminating (SIGTERM) 09:29:59.523585 run iperf3-srv_10.42.42.10(pid=32387): Terminating (SIGTERM) 09:29:59.565093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32390): Terminating (SIGTERM) 09:29:59.606575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32393): Terminating (SIGTERM) 09:29:59.648102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32396): Terminating (SIGTERM) 09:29:59.689961 --- ParallelTerminationStrategy: PID 32386 died... 09:29:59.710040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32386): Terminated: ok {rc=0} 09:29:59.756227 --- ParallelTerminationStrategy: PID 32387 died... 09:29:59.775936 run iperf3-srv_10.42.42.10(pid=32387): Terminated {rc=256} 09:29:59.822150 --- ParallelTerminationStrategy: PID 32390 died... 09:29:59.841788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32390): Terminated: ok {rc=0} 09:29:59.887600 --- ParallelTerminationStrategy: PID 32393 died... 09:29:59.907309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32393): Terminated: ok {rc=0} 09:29:59.953250 --- ParallelTerminationStrategy: PID 32396 died... 09:29:59.972788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32396): Terminated: ok {rc=0} 09:30:00.059642 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:30:01.232760 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.248800 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:30:01.307208 tst iperf3m4.py: using LAC 33037 09:30:01.461213 tst iperf3m4.py: using RAC 142 09:30:01.589269 tst iperf3m4.py: using CellId 33037 09:30:01.708518 tst iperf3m4.py: using BVCI 33038 09:30:01.819337 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.831113 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.849980 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.862527 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.880671 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.893803 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.906618 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.918988 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:01.931599 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:02.059590 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:02.204164 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:02.342761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:02.464377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:30:02.664275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:02.960705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32401): Launched 09:30:03.217867 run iperf3-srv_10.42.42.10(pid=32402): Launched 09:30:03.329367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:30:03.528176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:03.825166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32403): Launched 09:30:04.082461 run iperf3-srv_10.42.42.10(pid=32404): Launched 09:30:04.193147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:30:04.392307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:04.688134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32405): Launched 09:30:04.944875 run iperf3-srv_10.42.42.10(pid=32406): Launched 09:30:05.055973 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:30:05.254298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:05.550122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32407): Launched 09:30:05.806544 run iperf3-srv_10.42.42.10(pid=32408): Launched 09:30:05.917170 tst iperf3m4.py:8: start network... 09:30:06.115171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:06.571381 run create_hlr_db(pid=32409): Launched 09:30:06.686248 bus /gobi_6: Setting Powered False 09:30:07.745779 run create_hlr_db(pid=32409): Terminated: ok {rc=0} 09:30:08.178022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32411): Launched 09:30:08.492227 run osmo-hlr_10.42.42.2(pid=32412): Launched 09:30:08.612850 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:09.156718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32414): Launched 09:30:09.471331 run osmo-stp_10.42.42.5(pid=32415): Launched 09:30:09.592254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:10.135169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32417): Launched 09:30:10.254602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:10.520067 run patchelf(pid=32418): Launched 09:30:10.695063 run osmo-stp_10.42.42.5(pid=32415): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32415)] 09:30:10.828668 run osmo-stp_10.42.42.5(pid=32415): stdout: | (launched: 2022-12-13_09:30:09.413819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:10.963516 run osmo-stp_10.42.42.5(pid=32415): stderr: | 20221213093009608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093009608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093009608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093009608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093009609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093009609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093009609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:11.098754 run osmo-stp_10.42.42.5(pid=32415): stdout: | (launched: 2022-12-13_09:30:09.413819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:11.227899 run osmo-stp_10.42.42.5(pid=32415): stderr: | 20221213093009608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093009608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093009608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093009608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093009609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093009609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093009609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:11.381153 run patchelf(pid=32418): Terminating (SIGINT) 09:30:11.558327 run patchelf(pid=32418): Terminated: ok {rc=0} 09:30:11.685868 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32415): Process ended prematurely: osmo-stp_10.42.42.5(pid=32415) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32415)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 09:30:11.695959 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:30:11.724107 run osmo-hlr_10.42.42.2(pid=32412): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32412)] 09:30:11.773678 run osmo-hlr_10.42.42.2(pid=32412): stdout: | (launched: 2022-12-13_09:30:08.435200) 09:30:11.825290 run osmo-hlr_10.42.42.2(pid=32412): stderr: | 20221213093008632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093008632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093008632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093008633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093008633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093008633 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093008645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093008654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093008654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093008654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:11.876843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32401): Terminating (SIGTERM) 09:30:11.918569 run iperf3-srv_10.42.42.10(pid=32402): Terminating (SIGTERM) 09:30:11.960021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32403): Terminating (SIGTERM) 09:30:12.002253 run iperf3-srv_10.42.42.10(pid=32404): Terminating (SIGTERM) 09:30:12.043936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32405): Terminating (SIGTERM) 09:30:12.086042 run iperf3-srv_10.42.42.10(pid=32406): Terminating (SIGTERM) 09:30:12.127787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32407): Terminating (SIGTERM) 09:30:12.169407 run iperf3-srv_10.42.42.10(pid=32408): Terminating (SIGTERM) 09:30:12.211167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32411): Terminating (SIGTERM) 09:30:12.253176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32414): Terminating (SIGTERM) 09:30:12.294505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32417): Terminating (SIGTERM) 09:30:12.336474 --- ParallelTerminationStrategy: PID 32401 died... 09:30:12.356337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32401): Terminated: ok {rc=0} 09:30:12.402771 --- ParallelTerminationStrategy: PID 32402 died... 09:30:12.422028 run iperf3-srv_10.42.42.10(pid=32402): Terminated {rc=256} 09:30:12.467367 --- ParallelTerminationStrategy: PID 32403 died... 09:30:12.486672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32403): Terminated: ok {rc=0} 09:30:12.532024 --- ParallelTerminationStrategy: PID 32404 died... 09:30:12.551272 run iperf3-srv_10.42.42.10(pid=32404): Terminated {rc=256} 09:30:12.596811 --- ParallelTerminationStrategy: PID 32405 died... 09:30:12.616530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32405): Terminated: ok {rc=0} 09:30:12.661900 --- ParallelTerminationStrategy: PID 32406 died... 09:30:12.681184 run iperf3-srv_10.42.42.10(pid=32406): Terminated {rc=256} 09:30:12.726286 --- ParallelTerminationStrategy: PID 32407 died... 09:30:12.745540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32407): Terminated: ok {rc=0} 09:30:12.790631 --- ParallelTerminationStrategy: PID 32408 died... 09:30:12.809977 run iperf3-srv_10.42.42.10(pid=32408): Terminated {rc=256} 09:30:12.855542 --- ParallelTerminationStrategy: PID 32411 died... 09:30:12.874820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32411): Terminated: ok {rc=0} 09:30:12.919988 --- ParallelTerminationStrategy: PID 32414 died... 09:30:12.939295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32414): Terminated: ok {rc=0} 09:30:12.984406 --- ParallelTerminationStrategy: PID 32417 died... 09:30:13.003722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32417): Terminated: ok {rc=0} 09:30:13.090171 bus /gobi_4: Setting Powered False 09:30:14.188577 bus /gobi_4: Setting Powered False 09:30:15.303924 bus /gobi_1: Setting Powered False 09:30:16.398159 bus /gobi_1: Setting Powered False 09:30:17.514145 bus /gobi_0: Setting Powered False 09:30:18.612547 bus /gobi_0: Setting Powered False 09:30:19.728631 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 09:30:20.831147 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:20.843212 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:30:20.891093 tst ping.py: using LAC 33038 09:30:21.014259 tst ping.py: using RAC 143 09:30:21.135243 tst ping.py: using CellId 33038 09:30:21.256430 tst ping.py: using BVCI 33039 09:30:21.368364 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:21.379925 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:21.391138 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:21.402452 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:21.413586 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:21.424688 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:21.436086 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:21.447354 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:21.566072 tst ping.py:19: start network... 09:30:21.773826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:22.252799 run create_hlr_db(pid=32419): Launched 09:30:22.377705 bus /gobi_6: Setting Powered False 09:30:23.439067 run create_hlr_db(pid=32419): Terminated: ok {rc=0} 09:30:23.853975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32421): Launched 09:30:24.142504 run osmo-hlr_10.42.42.2(pid=32422): Launched 09:30:24.252593 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:24.765326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32424): Launched 09:30:25.054394 run osmo-stp_10.42.42.5(pid=32425): Launched 09:30:25.163828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:25.667026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32427): Launched 09:30:25.778340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:26.024320 run patchelf(pid=32428): Launched 09:30:26.186312 run osmo-stp_10.42.42.5(pid=32425): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32425)] 09:30:26.309953 run osmo-stp_10.42.42.5(pid=32425): stdout: | (launched: 2022-12-13_09:30:25.001796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:26.435124 run osmo-stp_10.42.42.5(pid=32425): stderr: | 20221213093025172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093025172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093025172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093025173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093025173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093025173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093025173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:26.560412 run osmo-stp_10.42.42.5(pid=32425): stdout: | (launched: 2022-12-13_09:30:25.001796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:26.680476 run osmo-stp_10.42.42.5(pid=32425): stderr: | 20221213093025172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093025172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093025172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093025173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093025173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093025173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093025173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:26.822313 run patchelf(pid=32428): Terminating (SIGINT) 09:30:26.985911 run patchelf(pid=32428): Terminated: ok {rc=0} 09:30:27.103896 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32425): Process ended prematurely: osmo-stp_10.42.42.5(pid=32425) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32425)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 09:30:27.112726 tst ping.py:22: Test FAILED (6.3 sec) 09:30:27.139247 run osmo-hlr_10.42.42.2(pid=32422): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32422)] 09:30:27.187018 run osmo-hlr_10.42.42.2(pid=32422): stdout: | (launched: 2022-12-13_09:30:24.089786) 09:30:27.237045 run osmo-hlr_10.42.42.2(pid=32422): stderr: | 20221213093024262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093024262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093024262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093024262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093024262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093024262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093024275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093024285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093024285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093024286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:27.286860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32421): Terminating (SIGTERM) 09:30:27.326607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32424): Terminating (SIGTERM) 09:30:27.366365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32427): Terminating (SIGTERM) 09:30:27.406424 --- ParallelTerminationStrategy: PID 32421 died... 09:30:27.425922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32421): Terminated: ok {rc=0} 09:30:27.469908 --- ParallelTerminationStrategy: PID 32424 died... 09:30:27.488813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32424): Terminated: ok {rc=0} 09:30:27.532660 --- ParallelTerminationStrategy: PID 32427 died... 09:30:27.551487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32427): Terminated: ok {rc=0} 09:30:27.635474 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:30:28.722074 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:28.734498 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:30:28.783271 tst ping_idle_ping.py: using LAC 33039 09:30:28.906261 tst ping_idle_ping.py: using RAC 144 09:30:29.028128 tst ping_idle_ping.py: using CellId 33039 09:30:29.145717 tst ping_idle_ping.py: using BVCI 33040 09:30:29.260285 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:29.271876 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:29.283109 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:29.294336 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:29.305561 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:29.316796 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:29.328299 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:29.339563 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:29.457190 tst ping_idle_ping.py:24: start network... 09:30:29.666700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:30.150111 run create_hlr_db(pid=32429): Launched 09:30:30.275685 bus /gobi_6: Setting Powered False 09:30:31.338133 run create_hlr_db(pid=32429): Terminated: ok {rc=0} 09:30:31.779059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32431): Launched 09:30:32.105763 run osmo-hlr_10.42.42.2(pid=32432): Launched 09:30:32.234212 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:32.748564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32434): Launched 09:30:33.039303 run osmo-stp_10.42.42.5(pid=32435): Launched 09:30:33.150891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:33.653189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32437): Launched 09:30:33.764433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:34.010050 run patchelf(pid=32438): Launched 09:30:34.171748 run osmo-stp_10.42.42.5(pid=32435): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32435)] 09:30:34.295436 run osmo-stp_10.42.42.5(pid=32435): stdout: | (launched: 2022-12-13_09:30:32.986114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:34.420724 run osmo-stp_10.42.42.5(pid=32435): stderr: | 20221213093033155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093033155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093033155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093033156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093033156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093033156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093033156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:34.546116 run osmo-stp_10.42.42.5(pid=32435): stdout: | (launched: 2022-12-13_09:30:32.986114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:34.666402 run osmo-stp_10.42.42.5(pid=32435): stderr: | 20221213093033155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093033155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093033155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093033156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093033156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093033156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093033156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:34.808759 run patchelf(pid=32438): Terminating (SIGINT) 09:30:34.972269 run patchelf(pid=32438): Terminated: ok {rc=0} 09:30:35.090216 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32435): Process ended prematurely: osmo-stp_10.42.42.5(pid=32435) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32435)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 09:30:35.099117 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:30:35.125551 run osmo-hlr_10.42.42.2(pid=32432): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32432)] 09:30:35.173134 run osmo-hlr_10.42.42.2(pid=32432): stdout: | (launched: 2022-12-13_09:30:32.046778) 09:30:35.222429 run osmo-hlr_10.42.42.2(pid=32432): stderr: | 20221213093032254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093032254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093032254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093032255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093032255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093032255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093032272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093032282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093032282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093032282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:35.271904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32431): Terminating (SIGTERM) 09:30:35.311820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32434): Terminating (SIGTERM) 09:30:35.351635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32437): Terminating (SIGTERM) 09:30:35.391594 --- ParallelTerminationStrategy: PID 32431 died... 09:30:35.411018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32431): Terminated: ok {rc=0} 09:30:35.454898 --- ParallelTerminationStrategy: PID 32434 died... 09:30:35.473736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32434): Terminated: ok {rc=0} 09:30:35.517414 --- ParallelTerminationStrategy: PID 32437 died... 09:30:35.536227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32437): Terminated: ok {rc=0} 09:30:35.619589 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:30:36.915469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:30:36.922120 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:30:36.951654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:30:36.991209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:30:37.079149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:30:37.108581 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:30:37.147857 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:30:37.746269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:30:37.797068 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:37.808429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:30:37.875954 tst cs_paging_gprs_active.py: using LAC 33040 09:30:38.000174 tst cs_paging_gprs_active.py: using RAC 145 09:30:38.118175 tst cs_paging_gprs_active.py: using CellId 33040 09:30:38.234502 tst cs_paging_gprs_active.py: using BVCI 33041 09:30:38.341918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.353150 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.364075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.374941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.386076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.397058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.408215 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.419358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:38.430455 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:30:38.550555 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:30:38.666465 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:30:38.865430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:39.162119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32442): Launched 09:30:39.419747 run iperf3-srv_10.42.42.10(pid=32443): Launched 09:30:39.531225 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:30:39.730272 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:40.027226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Launched 09:30:40.285389 run iperf3-srv_10.42.42.10(pid=32445): Launched 09:30:40.396493 tst cs_paging_gprs_active.py:38: start network... 09:30:40.594376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:41.054692 run create_hlr_db(pid=32446): Launched 09:30:41.167683 bus /gobi_6: Setting Powered False 09:30:42.227199 run create_hlr_db(pid=32446): Terminated: ok {rc=0} 09:30:42.661820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Launched 09:30:42.978952 run osmo-hlr_10.42.42.2(pid=32449): Launched 09:30:43.100539 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:43.646395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Launched 09:30:43.963802 run osmo-stp_10.42.42.5(pid=32452): Launched 09:30:44.084672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:44.630481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32454): Launched 09:30:44.751078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:45.019044 run patchelf(pid=32455): Launched 09:30:45.195013 run osmo-stp_10.42.42.5(pid=32452): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] 09:30:45.328860 run osmo-stp_10.42.42.5(pid=32452): stdout: | (launched: 2022-12-13_09:30:43.906324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:45.464395 run osmo-stp_10.42.42.5(pid=32452): stderr: | 20221213093044096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093044096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093044096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093044097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093044097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093044097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093044097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:45.599663 run osmo-stp_10.42.42.5(pid=32452): stdout: | (launched: 2022-12-13_09:30:43.906324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:45.729991 run osmo-stp_10.42.42.5(pid=32452): stderr: | 20221213093044096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093044096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093044096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093044097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093044097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093044097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093044097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:45.890199 run patchelf(pid=32455): Terminating (SIGINT) 09:30:46.064266 run patchelf(pid=32455): Terminated: ok {rc=0} 09:30:46.191738 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32452): Process ended prematurely: osmo-stp_10.42.42.5(pid=32452) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:30:46.202502 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:30:46.231034 run osmo-hlr_10.42.42.2(pid=32449): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32449)] 09:30:46.291102 run osmo-hlr_10.42.42.2(pid=32449): stdout: | (launched: 2022-12-13_09:30:42.921523) 09:30:46.356904 run osmo-hlr_10.42.42.2(pid=32449): stderr: | 20221213093043120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093043120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093043120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093043120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093043120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093043120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093043131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093043139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093043139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093043139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:46.421886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32442): Terminating (SIGTERM) 09:30:46.463465 run iperf3-srv_10.42.42.10(pid=32443): Terminating (SIGTERM) 09:30:46.505794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Terminating (SIGTERM) 09:30:46.549725 run iperf3-srv_10.42.42.10(pid=32445): Terminating (SIGTERM) 09:30:46.593069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Terminating (SIGTERM) 09:30:46.636660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Terminating (SIGTERM) 09:30:46.681825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32454): Terminating (SIGTERM) 09:30:46.727531 --- ParallelTerminationStrategy: PID 32442 died... 09:30:46.749200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32442): Terminated: ok {rc=0} 09:30:46.797657 --- ParallelTerminationStrategy: PID 32443 died... 09:30:46.819589 run iperf3-srv_10.42.42.10(pid=32443): Terminated {rc=256} 09:30:46.866945 --- ParallelTerminationStrategy: PID 32444 died... 09:30:46.888543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Terminated: ok {rc=0} 09:30:46.936581 --- ParallelTerminationStrategy: PID 32445 died... 09:30:46.957548 run iperf3-srv_10.42.42.10(pid=32445): Terminated {rc=256} 09:30:47.005804 --- ParallelTerminationStrategy: PID 32448 died... 09:30:47.039739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Terminated: ok {rc=0} 09:30:47.091899 --- ParallelTerminationStrategy: PID 32451 died... 09:30:47.114279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Terminated: ok {rc=0} 09:30:47.162723 --- ParallelTerminationStrategy: PID 32454 died... 09:30:47.183825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32454): Terminated: ok {rc=0} 09:30:47.275358 bus /gobi_0: Setting Powered False 09:30:48.373696 bus /gobi_0: Setting Powered False 09:30:49.484607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:30:50.631059 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:50.643213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:30:50.712535 tst iperf3.py: using LAC 33041 09:30:50.830706 tst iperf3.py: using RAC 146 09:30:50.947142 tst iperf3.py: using CellId 33041 09:30:51.064597 tst iperf3.py: using BVCI 33042 09:30:51.171771 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.182954 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.194055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.204668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.215705 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.226740 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.237911 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.248852 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:51.260088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:30:51.379091 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:30:51.592805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:51.913957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32458): Launched 09:30:52.188792 run iperf3-srv_10.42.42.10(pid=32459): Launched 09:30:52.307537 tst iperf3.py:8: start network... 09:30:52.521004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:53.010568 run create_hlr_db(pid=32460): Launched 09:30:53.138740 bus /gobi_6: Setting Powered False 09:30:54.201104 run create_hlr_db(pid=32460): Terminated: ok {rc=0} 09:30:54.622776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32462): Launched 09:30:54.917029 run osmo-hlr_10.42.42.2(pid=32463): Launched 09:30:55.029641 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:55.559815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32465): Launched 09:30:55.855628 run osmo-stp_10.42.42.5(pid=32466): Launched 09:30:55.968405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:56.478434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32468): Launched 09:30:56.592100 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:56.842381 run patchelf(pid=32469): Launched 09:30:57.007228 run osmo-stp_10.42.42.5(pid=32466): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32466)] 09:30:57.133661 run osmo-stp_10.42.42.5(pid=32466): stdout: | (launched: 2022-12-13_09:30:55.801458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:57.261135 run osmo-stp_10.42.42.5(pid=32466): stderr: | 20221213093055970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093055970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093055970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093055971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093055971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093055971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093055971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:57.388682 run osmo-stp_10.42.42.5(pid=32466): stdout: | (launched: 2022-12-13_09:30:55.801458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:57.510652 run osmo-stp_10.42.42.5(pid=32466): stderr: | 20221213093055970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093055970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093055970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093055971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093055971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093055971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093055971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:57.654843 run patchelf(pid=32469): Terminating (SIGINT) 09:30:57.822064 run patchelf(pid=32469): Terminated: ok {rc=0} 09:30:57.942920 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32466): Process ended prematurely: osmo-stp_10.42.42.5(pid=32466) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32466)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 09:30:57.952329 tst iperf3.py:8: Test FAILED (7.4 sec) 09:30:57.979210 run osmo-hlr_10.42.42.2(pid=32463): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32463)] 09:30:58.026909 run osmo-hlr_10.42.42.2(pid=32463): stdout: | (launched: 2022-12-13_09:30:54.863291) 09:30:58.076125 run osmo-hlr_10.42.42.2(pid=32463): stderr: | 20221213093055037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093055037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093055037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093055037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093055037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093055037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093055053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093055061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093055061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093055061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:58.126004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32458): Terminating (SIGTERM) 09:30:58.165839 run iperf3-srv_10.42.42.10(pid=32459): Terminating (SIGTERM) 09:30:58.205483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32462): Terminating (SIGTERM) 09:30:58.245227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32465): Terminating (SIGTERM) 09:30:58.284822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32468): Terminating (SIGTERM) 09:30:58.324498 --- ParallelTerminationStrategy: PID 32458 died... 09:30:58.344025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32458): Terminated: ok {rc=0} 09:30:58.387910 --- ParallelTerminationStrategy: PID 32459 died... 09:30:58.406791 run iperf3-srv_10.42.42.10(pid=32459): Terminated {rc=256} 09:30:58.450600 --- ParallelTerminationStrategy: PID 32462 died... 09:30:58.469473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32462): Terminated: ok {rc=0} 09:30:58.513127 --- ParallelTerminationStrategy: PID 32465 died... 09:30:58.531936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32465): Terminated: ok {rc=0} 09:30:58.575587 --- ParallelTerminationStrategy: PID 32468 died... 09:30:58.594414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32468): Terminated: ok {rc=0} 09:30:58.677019 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:30:59.824046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:59.836286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:30:59.907316 tst iperf3m4.py: using LAC 33042 09:31:00.030970 tst iperf3m4.py: using RAC 147 09:31:00.153185 tst iperf3m4.py: using CellId 33042 09:31:00.278726 tst iperf3m4.py: using BVCI 33043 09:31:00.394977 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.406552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.417949 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.429222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.440373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.451681 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.463056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.474289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:00.485711 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:00.600098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:00.721384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:00.839094 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:00.962591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:31:01.190659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:01.516121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32470): Launched 09:31:01.810128 run iperf3-srv_10.42.42.10(pid=32471): Launched 09:31:01.944132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:31:02.160761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:02.466819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32472): Launched 09:31:02.724693 run iperf3-srv_10.42.42.10(pid=32473): Launched 09:31:02.836491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:31:03.035860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:03.334068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32474): Launched 09:31:03.592631 run iperf3-srv_10.42.42.10(pid=32475): Launched 09:31:03.703629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:31:03.902446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:04.199585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32476): Launched 09:31:04.456788 run iperf3-srv_10.42.42.10(pid=32477): Launched 09:31:04.568326 tst iperf3m4.py:8: start network... 09:31:04.766460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:05.224803 run create_hlr_db(pid=32478): Launched 09:31:05.339193 bus /gobi_6: Setting Powered False 09:31:06.398251 run create_hlr_db(pid=32478): Terminated: ok {rc=0} 09:31:06.831034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32480): Launched 09:31:07.146762 run osmo-hlr_10.42.42.2(pid=32481): Launched 09:31:07.267115 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:07.812380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Launched 09:31:08.128907 run osmo-stp_10.42.42.5(pid=32484): Launched 09:31:08.250101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:08.796825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32486): Launched 09:31:08.918154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:09.184668 run patchelf(pid=32487): Launched 09:31:09.359849 run osmo-stp_10.42.42.5(pid=32484): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] 09:31:09.493453 run osmo-stp_10.42.42.5(pid=32484): stdout: | (launched: 2022-12-13_09:31:08.071415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:09.627988 run osmo-stp_10.42.42.5(pid=32484): stderr: | 20221213093108264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093108264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093108264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093108265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093108265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093108265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093108265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:09.763076 run osmo-stp_10.42.42.5(pid=32484): stdout: | (launched: 2022-12-13_09:31:08.071415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:09.892692 run osmo-stp_10.42.42.5(pid=32484): stderr: | 20221213093108264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093108264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093108264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093108265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093108265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093108265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093108265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:10.046518 run patchelf(pid=32487): Terminating (SIGINT) 09:31:10.223329 run patchelf(pid=32487): Terminated: ok {rc=0} 09:31:10.351085 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32484): Process ended prematurely: osmo-stp_10.42.42.5(pid=32484) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:31:10.361171 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:31:10.389403 run osmo-hlr_10.42.42.2(pid=32481): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32481)] 09:31:10.438755 run osmo-hlr_10.42.42.2(pid=32481): stdout: | (launched: 2022-12-13_09:31:07.089644) 09:31:10.489797 run osmo-hlr_10.42.42.2(pid=32481): stderr: | 20221213093107287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093107287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093107287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093107287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093107287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093107288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093107300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093107309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093107309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093107309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:10.541360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32470): Terminating (SIGTERM) 09:31:10.582484 run iperf3-srv_10.42.42.10(pid=32471): Terminating (SIGTERM) 09:31:10.623691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32472): Terminating (SIGTERM) 09:31:10.664827 run iperf3-srv_10.42.42.10(pid=32473): Terminating (SIGTERM) 09:31:10.705944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32474): Terminating (SIGTERM) 09:31:10.747113 run iperf3-srv_10.42.42.10(pid=32475): Terminating (SIGTERM) 09:31:10.788107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32476): Terminating (SIGTERM) 09:31:10.829321 run iperf3-srv_10.42.42.10(pid=32477): Terminating (SIGTERM) 09:31:10.870819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32480): Terminating (SIGTERM) 09:31:10.912087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Terminating (SIGTERM) 09:31:10.953233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32486): Terminating (SIGTERM) 09:31:10.994576 --- ParallelTerminationStrategy: PID 32470 died... 09:31:11.014292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32470): Terminated: ok {rc=0} 09:31:11.059936 --- ParallelTerminationStrategy: PID 32471 died... 09:31:11.079227 run iperf3-srv_10.42.42.10(pid=32471): Terminated {rc=256} 09:31:11.124481 --- ParallelTerminationStrategy: PID 32472 died... 09:31:11.143800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32472): Terminated: ok {rc=0} 09:31:11.188931 --- ParallelTerminationStrategy: PID 32473 died... 09:31:11.208094 run iperf3-srv_10.42.42.10(pid=32473): Terminated {rc=256} 09:31:11.253775 --- ParallelTerminationStrategy: PID 32474 died... 09:31:11.272917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32474): Terminated: ok {rc=0} 09:31:11.318111 --- ParallelTerminationStrategy: PID 32475 died... 09:31:11.337274 run iperf3-srv_10.42.42.10(pid=32475): Terminated {rc=256} 09:31:11.382418 --- ParallelTerminationStrategy: PID 32476 died... 09:31:11.401666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32476): Terminated: ok {rc=0} 09:31:11.447053 --- ParallelTerminationStrategy: PID 32477 died... 09:31:11.466266 run iperf3-srv_10.42.42.10(pid=32477): Terminated {rc=256} 09:31:11.511591 --- ParallelTerminationStrategy: PID 32480 died... 09:31:11.530982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32480): Terminated: ok {rc=0} 09:31:11.576284 --- ParallelTerminationStrategy: PID 32483 died... 09:31:11.595639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Terminated: ok {rc=0} 09:31:11.641205 --- ParallelTerminationStrategy: PID 32486 died... 09:31:11.660361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32486): Terminated: ok {rc=0} 09:31:11.746952 bus /gobi_4: Setting Powered False 09:31:12.844062 bus /gobi_4: Setting Powered False 09:31:13.959674 bus /gobi_1: Setting Powered False 09:31:15.053876 bus /gobi_1: Setting Powered False 09:31:16.176880 bus /gobi_0: Setting Powered False 09:31:17.273912 bus /gobi_0: Setting Powered False 09:31:18.389397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:31:19.491051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:19.503092 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:31:19.570463 tst ping.py: using LAC 33043 09:31:19.692734 tst ping.py: using RAC 148 09:31:19.814645 tst ping.py: using CellId 33043 09:31:19.935873 tst ping.py: using BVCI 33044 09:31:20.048245 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:20.059829 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:20.071367 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:20.082761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:20.093970 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:20.105367 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:20.116657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:20.127989 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:20.241753 tst ping.py:19: start network... 09:31:20.435834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:20.885697 run create_hlr_db(pid=32488): Launched 09:31:20.996927 bus /gobi_6: Setting Powered False 09:31:22.054813 run create_hlr_db(pid=32488): Terminated: ok {rc=0} 09:31:22.479495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32490): Launched 09:31:22.789413 run osmo-hlr_10.42.42.2(pid=32491): Launched 09:31:22.908466 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:23.449682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32493): Launched 09:31:23.759229 run osmo-stp_10.42.42.5(pid=32494): Launched 09:31:23.877735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:24.415661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32496): Launched 09:31:24.534219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:24.797230 run patchelf(pid=32497): Launched 09:31:24.970098 run osmo-stp_10.42.42.5(pid=32494): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32494)] 09:31:25.101797 run osmo-stp_10.42.42.5(pid=32494): stdout: | (launched: 2022-12-13_09:31:23.702961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:25.235186 run osmo-stp_10.42.42.5(pid=32494): stderr: | 20221213093123893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093123893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093123893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093123894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093123896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093123896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093123896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:25.368496 run osmo-stp_10.42.42.5(pid=32494): stdout: | (launched: 2022-12-13_09:31:23.702961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:25.496134 run osmo-stp_10.42.42.5(pid=32494): stderr: | 20221213093123893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093123893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093123893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093123894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093123896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093123896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093123896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:25.647348 run patchelf(pid=32497): Terminating (SIGINT) 09:31:25.821549 run patchelf(pid=32497): Terminated: ok {rc=0} 09:31:25.947505 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32494): Process ended prematurely: osmo-stp_10.42.42.5(pid=32494) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32494)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 09:31:25.956942 tst ping.py:22: Test FAILED (6.5 sec) 09:31:25.984555 run osmo-hlr_10.42.42.2(pid=32491): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32491)] 09:31:26.034426 run osmo-hlr_10.42.42.2(pid=32491): stdout: | (launched: 2022-12-13_09:31:22.733052) 09:31:26.086104 run osmo-hlr_10.42.42.2(pid=32491): stderr: | 20221213093122932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093122932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093122932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093122932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093122932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093122932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093122944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093122953 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093122953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093122953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:26.138142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32490): Terminating (SIGTERM) 09:31:26.179477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32493): Terminating (SIGTERM) 09:31:26.220806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32496): Terminating (SIGTERM) 09:31:26.262861 --- ParallelTerminationStrategy: PID 32490 died... 09:31:26.282982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32490): Terminated: ok {rc=0} 09:31:26.328914 --- ParallelTerminationStrategy: PID 32493 died... 09:31:26.348463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32493): Terminated: ok {rc=0} 09:31:26.394006 --- ParallelTerminationStrategy: PID 32496 died... 09:31:26.413487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32496): Terminated: ok {rc=0} 09:31:26.500942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:31:27.587187 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:27.599198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:31:27.668136 tst ping_idle_ping.py: using LAC 33044 09:31:27.792350 tst ping_idle_ping.py: using RAC 149 09:31:27.914224 tst ping_idle_ping.py: using CellId 33044 09:31:28.037796 tst ping_idle_ping.py: using BVCI 33045 09:31:28.151156 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:28.162644 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:28.173987 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:28.185234 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:28.196477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:28.207813 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:28.219192 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:28.230493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:28.345500 tst ping_idle_ping.py:24: start network... 09:31:28.540731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:28.996105 run create_hlr_db(pid=32498): Launched 09:31:29.108064 bus /gobi_6: Setting Powered False 09:31:30.166373 run create_hlr_db(pid=32498): Terminated: ok {rc=0} 09:31:30.574348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32500): Launched 09:31:30.875471 run osmo-hlr_10.42.42.2(pid=32501): Launched 09:31:31.130342 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:31.821169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32503): Launched 09:31:32.133895 run osmo-stp_10.42.42.5(pid=32504): Launched 09:31:32.352851 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:32.881650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32506): Launched 09:31:32.993156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:33.239442 run patchelf(pid=32507): Launched 09:31:33.401913 run osmo-stp_10.42.42.5(pid=32504): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32504)] 09:31:33.525884 run osmo-stp_10.42.42.5(pid=32504): stdout: | (launched: 2022-12-13_09:31:32.073242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:33.651553 run osmo-stp_10.42.42.5(pid=32504): stderr: | 20221213093132351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093132351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093132351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093132352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093132352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093132352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093132353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:33.777110 run osmo-stp_10.42.42.5(pid=32504): stdout: | (launched: 2022-12-13_09:31:32.073242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:33.897518 run osmo-stp_10.42.42.5(pid=32504): stderr: | 20221213093132351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093132351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093132351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093132352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093132352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093132352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093132353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:34.039980 run patchelf(pid=32507): Terminating (SIGINT) 09:31:34.205455 run patchelf(pid=32507): Terminated: ok {rc=0} 09:31:34.324061 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32504): Process ended prematurely: osmo-stp_10.42.42.5(pid=32504) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32504)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:31:34.332943 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:31:34.359272 run osmo-hlr_10.42.42.2(pid=32501): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32501)] 09:31:34.406653 run osmo-hlr_10.42.42.2(pid=32501): stdout: | (launched: 2022-12-13_09:31:30.812473) 09:31:34.455388 run osmo-hlr_10.42.42.2(pid=32501): stderr: | 20221213093131173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093131173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093131173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093131173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093131173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093131173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093131198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093131218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093131218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093131218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:34.504724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32500): Terminating (SIGTERM) 09:31:34.544241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32503): Terminating (SIGTERM) 09:31:34.583831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32506): Terminating (SIGTERM) 09:31:34.623421 --- ParallelTerminationStrategy: PID 32500 died... 09:31:34.642649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32500): Terminated: ok {rc=0} 09:31:34.686057 --- ParallelTerminationStrategy: PID 32503 died... 09:31:34.704537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32503): Terminated: ok {rc=0} 09:31:34.747957 --- ParallelTerminationStrategy: PID 32506 died... 09:31:34.766598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32506): Terminated: ok {rc=0} 09:31:34.851628 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:31:36.160176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:31:36.166902 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:31:36.196455 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:31:36.237296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:31:36.323276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:31:36.352200 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:31:36.390834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:31:36.985358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:31:37.034342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.045753 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:31:37.111283 tst cs_paging_gprs_active.py: using LAC 33045 09:31:37.228910 tst cs_paging_gprs_active.py: using RAC 150 09:31:37.345366 tst cs_paging_gprs_active.py: using CellId 33045 09:31:37.461819 tst cs_paging_gprs_active.py: using BVCI 33046 09:31:37.569863 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.581279 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.592359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.603475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.615098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.626659 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.638380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.649834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:37.661465 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:31:37.781673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:31:37.901387 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:31:38.116207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:38.434375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32512): Launched 09:31:38.710471 run iperf3-srv_10.42.42.10(pid=32513): Launched 09:31:38.829912 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:31:39.044871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:39.364016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32514): Launched 09:31:39.640067 run iperf3-srv_10.42.42.10(pid=32515): Launched 09:31:39.759694 tst cs_paging_gprs_active.py:38: start network... 09:31:39.976103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:40.439627 run create_hlr_db(pid=32516): Launched 09:31:40.553522 bus /gobi_6: Setting Powered False 09:31:41.612922 run create_hlr_db(pid=32516): Terminated: ok {rc=0} 09:31:42.029140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32518): Launched 09:31:42.328450 run osmo-hlr_10.42.42.2(pid=32519): Launched 09:31:42.442927 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:42.971271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32521): Launched 09:31:43.268345 run osmo-stp_10.42.42.5(pid=32522): Launched 09:31:43.382978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:43.894744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32524): Launched 09:31:44.008180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:44.266410 run patchelf(pid=32525): Launched 09:31:44.432815 run osmo-stp_10.42.42.5(pid=32522): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32522)] 09:31:44.559684 run osmo-stp_10.42.42.5(pid=32522): stdout: | (launched: 2022-12-13_09:31:43.213716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:44.688293 run osmo-stp_10.42.42.5(pid=32522): stderr: | 20221213093143385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093143386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093143386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093143386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093143387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093143387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093143387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:44.816462 run osmo-stp_10.42.42.5(pid=32522): stdout: | (launched: 2022-12-13_09:31:43.213716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:44.939201 run osmo-stp_10.42.42.5(pid=32522): stderr: | 20221213093143385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093143386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093143386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093143386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093143387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093143387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093143387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:45.084148 run patchelf(pid=32525): Terminating (SIGINT) 09:31:45.252524 run patchelf(pid=32525): Terminated: ok {rc=0} 09:31:45.373814 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32522): Process ended prematurely: osmo-stp_10.42.42.5(pid=32522) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32522)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:31:45.383272 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:31:45.410097 run osmo-hlr_10.42.42.2(pid=32519): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32519)] 09:31:45.458112 run osmo-hlr_10.42.42.2(pid=32519): stdout: | (launched: 2022-12-13_09:31:42.273570) 09:31:45.507527 run osmo-hlr_10.42.42.2(pid=32519): stderr: | 20221213093142451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093142451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093142451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093142451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093142451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093142451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093142463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093142471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093142472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093142472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:45.557424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32512): Terminating (SIGTERM) 09:31:45.597289 run iperf3-srv_10.42.42.10(pid=32513): Terminating (SIGTERM) 09:31:45.637047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32514): Terminating (SIGTERM) 09:31:45.677040 run iperf3-srv_10.42.42.10(pid=32515): Terminating (SIGTERM) 09:31:45.717428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32518): Terminating (SIGTERM) 09:31:45.761645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32521): Terminating (SIGTERM) 09:31:45.803327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32524): Terminating (SIGTERM) 09:31:45.849429 --- ParallelTerminationStrategy: PID 32512 died... 09:31:45.870868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32512): Terminated: ok {rc=0} 09:31:45.925798 --- ParallelTerminationStrategy: PID 32513 died... 09:31:45.945508 run iperf3-srv_10.42.42.10(pid=32513): Terminated {rc=256} 09:31:45.991107 --- ParallelTerminationStrategy: PID 32514 died... 09:31:46.011852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32514): Terminated: ok {rc=0} 09:31:46.057587 --- ParallelTerminationStrategy: PID 32515 died... 09:31:46.078127 run iperf3-srv_10.42.42.10(pid=32515): Terminated {rc=256} 09:31:46.123988 --- ParallelTerminationStrategy: PID 32518 died... 09:31:46.144344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32518): Terminated: ok {rc=0} 09:31:46.190245 --- ParallelTerminationStrategy: PID 32521 died... 09:31:46.210629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32521): Terminated: ok {rc=0} 09:31:46.257854 --- ParallelTerminationStrategy: PID 32524 died... 09:31:46.278246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32524): Terminated: ok {rc=0} 09:31:46.366008 bus /gobi_0: Setting Powered False 09:31:47.461566 bus /gobi_0: Setting Powered False 09:31:48.573373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:31:49.719749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:49.731871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:31:49.800359 tst iperf3.py: using LAC 33046 09:31:49.924781 tst iperf3.py: using RAC 151 09:31:50.048575 tst iperf3.py: using CellId 33046 09:31:50.172283 tst iperf3.py: using BVCI 33047 09:31:50.287927 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.299552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.310874 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.322443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.333824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.345173 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.356506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.367711 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:50.379227 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:31:50.495965 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:31:50.696395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:50.994461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32526): Launched 09:31:51.252017 run iperf3-srv_10.42.42.10(pid=32527): Launched 09:31:51.363432 tst iperf3.py:8: start network... 09:31:51.562451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:52.022403 run create_hlr_db(pid=32528): Launched 09:31:52.135965 bus /gobi_6: Setting Powered False 09:31:53.195659 run create_hlr_db(pid=32528): Terminated: ok {rc=0} 09:31:53.629729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32530): Launched 09:31:53.947505 run osmo-hlr_10.42.42.2(pid=32531): Launched 09:31:54.068361 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:54.616212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32533): Launched 09:31:54.934630 run osmo-stp_10.42.42.5(pid=32534): Launched 09:31:55.055579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:55.602233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32536): Launched 09:31:55.722850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:55.990275 run patchelf(pid=32537): Launched 09:31:56.166038 run osmo-stp_10.42.42.5(pid=32534): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32534)] 09:31:56.300778 run osmo-stp_10.42.42.5(pid=32534): stdout: | (launched: 2022-12-13_09:31:54.876836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:56.436798 run osmo-stp_10.42.42.5(pid=32534): stderr: | 20221213093155070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093155070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093155070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093155070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093155071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093155071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093155071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:56.572925 run osmo-stp_10.42.42.5(pid=32534): stdout: | (launched: 2022-12-13_09:31:54.876836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:56.703233 run osmo-stp_10.42.42.5(pid=32534): stderr: | 20221213093155070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093155070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093155070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093155070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093155071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093155071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093155071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:56.857306 run patchelf(pid=32537): Terminating (SIGINT) 09:31:57.035104 run patchelf(pid=32537): Terminated: ok {rc=0} 09:31:57.163150 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32534): Process ended prematurely: osmo-stp_10.42.42.5(pid=32534) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32534)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 09:31:57.173155 tst iperf3.py:8: Test FAILED (7.5 sec) 09:31:57.201733 run osmo-hlr_10.42.42.2(pid=32531): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32531)] 09:31:57.251555 run osmo-hlr_10.42.42.2(pid=32531): stdout: | (launched: 2022-12-13_09:31:53.889943) 09:31:57.303028 run osmo-hlr_10.42.42.2(pid=32531): stderr: | 20221213093154088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093154088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093154088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093154088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093154088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093154088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093154101 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093154109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093154109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093154109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:57.355151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32526): Terminating (SIGTERM) 09:31:57.396880 run iperf3-srv_10.42.42.10(pid=32527): Terminating (SIGTERM) 09:31:57.438581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32530): Terminating (SIGTERM) 09:31:57.480714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32533): Terminating (SIGTERM) 09:31:57.523401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32536): Terminating (SIGTERM) 09:31:57.565238 --- ParallelTerminationStrategy: PID 32526 died... 09:31:57.585553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32526): Terminated: ok {rc=0} 09:31:57.631689 --- ParallelTerminationStrategy: PID 32527 died... 09:31:57.651326 run iperf3-srv_10.42.42.10(pid=32527): Terminated {rc=256} 09:31:57.696882 --- ParallelTerminationStrategy: PID 32530 died... 09:31:57.717034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32530): Terminated: ok {rc=0} 09:31:57.762798 --- ParallelTerminationStrategy: PID 32533 died... 09:31:57.782645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32533): Terminated: ok {rc=0} 09:31:57.828443 --- ParallelTerminationStrategy: PID 32536 died... 09:31:57.848134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32536): Terminated: ok {rc=0} 09:31:57.936632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:31:59.083830 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.096037 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:31:59.163378 tst iperf3m4.py: using LAC 33047 09:31:59.287490 tst iperf3m4.py: using RAC 152 09:31:59.412909 tst iperf3m4.py: using CellId 33047 09:31:59.536589 tst iperf3m4.py: using BVCI 33048 09:31:59.652377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.663958 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.675265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.686601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.698005 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.709345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.720682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.731923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:31:59.743420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:31:59.859582 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:31:59.982399 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:32:00.097800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:32:00.213615 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:32:00.413941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:00.711728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32538): Launched 09:32:01.029618 run iperf3-srv_10.42.42.10(pid=32539): Launched 09:32:01.153481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:32:01.357364 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:01.662539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32540): Launched 09:32:01.958981 run iperf3-srv_10.42.42.10(pid=32541): Launched 09:32:02.084936 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:32:02.287345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:02.586151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32542): Launched 09:32:02.844062 run iperf3-srv_10.42.42.10(pid=32543): Launched 09:32:02.955378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:32:03.154346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:03.453257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32544): Launched 09:32:03.711780 run iperf3-srv_10.42.42.10(pid=32545): Launched 09:32:03.823520 tst iperf3m4.py:8: start network... 09:32:04.021699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:04.482124 run create_hlr_db(pid=32546): Launched 09:32:04.596238 bus /gobi_6: Setting Powered False 09:32:05.654855 run create_hlr_db(pid=32546): Terminated: ok {rc=0} 09:32:06.089699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32548): Launched 09:32:06.406459 run osmo-hlr_10.42.42.2(pid=32549): Launched 09:32:06.527281 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:07.079255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32551): Launched 09:32:07.396865 run osmo-stp_10.42.42.5(pid=32552): Launched 09:32:07.519145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:08.067772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32554): Launched 09:32:08.189243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:08.457950 run patchelf(pid=32555): Launched 09:32:08.634133 run osmo-stp_10.42.42.5(pid=32552): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32552)] 09:32:08.768772 run osmo-stp_10.42.42.5(pid=32552): stdout: | (launched: 2022-12-13_09:32:07.339091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:08.905336 run osmo-stp_10.42.42.5(pid=32552): stderr: | 20221213093207530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093207530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093207531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093207531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093207533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093207534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093207534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:09.041517 run osmo-stp_10.42.42.5(pid=32552): stdout: | (launched: 2022-12-13_09:32:07.339091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:09.171814 run osmo-stp_10.42.42.5(pid=32552): stderr: | 20221213093207530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093207530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093207531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093207531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093207533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093207534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093207534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:09.326710 run patchelf(pid=32555): Terminating (SIGINT) 09:32:09.504514 run patchelf(pid=32555): Terminated: ok {rc=0} 09:32:09.632896 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32552): Process ended prematurely: osmo-stp_10.42.42.5(pid=32552) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32552)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:32:09.643246 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:32:09.671800 run osmo-hlr_10.42.42.2(pid=32549): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32549)] 09:32:09.721784 run osmo-hlr_10.42.42.2(pid=32549): stdout: | (launched: 2022-12-13_09:32:06.348458) 09:32:09.773540 run osmo-hlr_10.42.42.2(pid=32549): stderr: | 20221213093206548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093206548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093206548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093206548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093206548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093206548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093206561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093206569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093206569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093206569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:09.825780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32538): Terminating (SIGTERM) 09:32:09.867814 run iperf3-srv_10.42.42.10(pid=32539): Terminating (SIGTERM) 09:32:09.910937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32540): Terminating (SIGTERM) 09:32:09.952640 run iperf3-srv_10.42.42.10(pid=32541): Terminating (SIGTERM) 09:32:09.994525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32542): Terminating (SIGTERM) 09:32:10.036394 run iperf3-srv_10.42.42.10(pid=32543): Terminating (SIGTERM) 09:32:10.078413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32544): Terminating (SIGTERM) 09:32:10.120052 run iperf3-srv_10.42.42.10(pid=32545): Terminating (SIGTERM) 09:32:10.162340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32548): Terminating (SIGTERM) 09:32:10.203975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32551): Terminating (SIGTERM) 09:32:10.246054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32554): Terminating (SIGTERM) 09:32:10.287613 --- ParallelTerminationStrategy: PID 32538 died... 09:32:10.307629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32538): Terminated: ok {rc=0} 09:32:10.354390 --- ParallelTerminationStrategy: PID 32539 died... 09:32:10.373797 run iperf3-srv_10.42.42.10(pid=32539): Terminated {rc=256} 09:32:10.419686 --- ParallelTerminationStrategy: PID 32540 died... 09:32:10.438997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32540): Terminated: ok {rc=0} 09:32:10.484536 --- ParallelTerminationStrategy: PID 32541 died... 09:32:10.503947 run iperf3-srv_10.42.42.10(pid=32541): Terminated {rc=256} 09:32:10.549575 --- ParallelTerminationStrategy: PID 32542 died... 09:32:10.569077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32542): Terminated: ok {rc=0} 09:32:10.614775 --- ParallelTerminationStrategy: PID 32543 died... 09:32:10.634239 run iperf3-srv_10.42.42.10(pid=32543): Terminated {rc=256} 09:32:10.679772 --- ParallelTerminationStrategy: PID 32544 died... 09:32:10.699190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32544): Terminated: ok {rc=0} 09:32:10.744794 --- ParallelTerminationStrategy: PID 32545 died... 09:32:10.764209 run iperf3-srv_10.42.42.10(pid=32545): Terminated {rc=256} 09:32:10.809699 --- ParallelTerminationStrategy: PID 32548 died... 09:32:10.829065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32548): Terminated: ok {rc=0} 09:32:10.874562 --- ParallelTerminationStrategy: PID 32551 died... 09:32:10.894305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32551): Terminated: ok {rc=0} 09:32:10.939894 --- ParallelTerminationStrategy: PID 32554 died... 09:32:10.959255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32554): Terminated: ok {rc=0} 09:32:11.046579 bus /gobi_4: Setting Powered False 09:32:12.145240 bus /gobi_4: Setting Powered False 09:32:13.260735 bus /gobi_1: Setting Powered False 09:32:14.357289 bus /gobi_1: Setting Powered False 09:32:15.471405 bus /gobi_0: Setting Powered False 09:32:16.571608 bus /gobi_0: Setting Powered False 09:32:17.689382 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:32:18.791180 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:18.802898 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:32:18.868475 tst ping.py: using LAC 33048 09:32:18.984209 tst ping.py: using RAC 153 09:32:19.099510 tst ping.py: using CellId 33048 09:32:19.213378 tst ping.py: using BVCI 33049 09:32:19.318913 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:19.330035 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:19.340834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:19.351720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:19.362908 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:19.374076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:19.385278 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:19.396437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:32:19.514397 tst ping.py:19: start network... 09:32:19.723275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:20.204826 run create_hlr_db(pid=32557): Launched 09:32:20.331864 bus /gobi_6: Setting Powered False 09:32:21.393654 run create_hlr_db(pid=32557): Terminated: ok {rc=0} 09:32:21.809737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Launched 09:32:22.122995 run osmo-hlr_10.42.42.2(pid=32560): Launched 09:32:22.240941 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:22.784429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Launched 09:32:23.095871 run osmo-stp_10.42.42.5(pid=32563): Launched 09:32:23.214970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:23.752240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32565): Launched 09:32:23.870842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:24.133625 run patchelf(pid=32566): Launched 09:32:24.306252 run osmo-stp_10.42.42.5(pid=32563): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] 09:32:24.438060 run osmo-stp_10.42.42.5(pid=32563): stdout: | (launched: 2022-12-13_09:32:23.038889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:24.571772 run osmo-stp_10.42.42.5(pid=32563): stderr: | 20221213093223229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093223230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093223230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093223230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093223231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093223231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093223231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:24.705271 run osmo-stp_10.42.42.5(pid=32563): stdout: | (launched: 2022-12-13_09:32:23.038889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:24.833182 run osmo-stp_10.42.42.5(pid=32563): stderr: | 20221213093223229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093223230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093223230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093223230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093223231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093223231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093223231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:24.984923 run patchelf(pid=32566): Terminating (SIGINT) 09:32:25.159372 run patchelf(pid=32566): Terminated: ok {rc=0} 09:32:25.285102 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32563): Process ended prematurely: osmo-stp_10.42.42.5(pid=32563) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 09:32:25.294620 tst ping.py:22: Test FAILED (6.5 sec) 09:32:25.322324 run osmo-hlr_10.42.42.2(pid=32560): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32560)] 09:32:25.371749 run osmo-hlr_10.42.42.2(pid=32560): stdout: | (launched: 2022-12-13_09:32:22.065650) 09:32:25.423137 run osmo-hlr_10.42.42.2(pid=32560): stderr: | 20221213093222261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093222261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093222261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093222261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093222261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093222261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093222275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093222285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093222286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093222286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:25.474759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminating (SIGTERM) 09:32:25.516045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Terminating (SIGTERM) 09:32:25.557781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32565): Terminating (SIGTERM) 09:32:25.599335 --- ParallelTerminationStrategy: PID 32559 died... 09:32:25.619298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminated: ok {rc=0} 09:32:25.665076 --- ParallelTerminationStrategy: PID 32562 died... 09:32:25.684369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Terminated: ok {rc=0} 09:32:25.729579 --- ParallelTerminationStrategy: PID 32565 died... 09:32:25.748783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32565): Terminated: ok {rc=0} 09:32:25.834123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:32:26.920194 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:26.932398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:32:27.004897 tst ping_idle_ping.py: using LAC 33049 09:32:27.128456 tst ping_idle_ping.py: using RAC 154 09:32:27.249593 tst ping_idle_ping.py: using CellId 33049 09:32:27.366183 tst ping_idle_ping.py: using BVCI 33050 09:32:27.472575 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:27.483976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:27.495032 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:27.506089 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:27.517230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:27.528923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:27.540258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:32:27.551511 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:32:27.668042 tst ping_idle_ping.py:24: start network... 09:32:27.878918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:28.366685 run create_hlr_db(pid=32567): Launched 09:32:28.493816 bus /gobi_6: Setting Powered False 09:32:29.556745 run create_hlr_db(pid=32567): Terminated: ok {rc=0} 09:32:29.975652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32569): Launched 09:32:30.268813 run osmo-hlr_10.42.42.2(pid=32570): Launched 09:32:30.381069 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:30.922005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32572): Launched 09:32:31.233810 run osmo-stp_10.42.42.5(pid=32573): Launched 09:32:31.463430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:32.142051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32575): Launched 09:32:32.267422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:32.516783 run patchelf(pid=32576): Launched 09:32:32.680136 run osmo-stp_10.42.42.5(pid=32573): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32573)] 09:32:32.804369 run osmo-stp_10.42.42.5(pid=32573): stdout: | (launched: 2022-12-13_09:32:31.176565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:32.930556 run osmo-stp_10.42.42.5(pid=32573): stderr: | 20221213093231501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093231501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093231502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093231502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093231502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093231503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093231503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:33.056197 run osmo-stp_10.42.42.5(pid=32573): stdout: | (launched: 2022-12-13_09:32:31.176565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:33.177111 run osmo-stp_10.42.42.5(pid=32573): stderr: | 20221213093231501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093231501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093231502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093231502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093231502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093231503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093231503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:33.319588 run patchelf(pid=32576): Terminating (SIGINT) 09:32:33.483754 run patchelf(pid=32576): Terminated: ok {rc=0} 09:32:33.602264 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32573): Process ended prematurely: osmo-stp_10.42.42.5(pid=32573) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32573)] [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:32:33.611111 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:32:33.637544 run osmo-hlr_10.42.42.2(pid=32570): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32570)] 09:32:33.685157 run osmo-hlr_10.42.42.2(pid=32570): stdout: | (launched: 2022-12-13_09:32:30.215140) 09:32:33.734203 run osmo-hlr_10.42.42.2(pid=32570): stderr: | 20221213093230391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093230391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093230391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093230391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093230391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093230391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093230403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093230412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093230412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093230412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:33.784111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32569): Terminating (SIGTERM) 09:32:33.824091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32572): Terminating (SIGTERM) 09:32:33.863944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32575): Terminating (SIGTERM) 09:32:33.904036 --- ParallelTerminationStrategy: PID 32569 died... 09:32:33.923557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32569): Terminated: ok {rc=0} 09:32:33.967934 --- ParallelTerminationStrategy: PID 32572 died... 09:32:33.986959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32572): Terminated: ok {rc=0} 09:32:34.030792 --- ParallelTerminationStrategy: PID 32575 died... 09:32:34.049765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32575): Terminated: ok {rc=0} 09:32:34.135543 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:32:35.433057 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:35.439583 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:32:35.468019 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:32:35.502942 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:32:35.556536 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:32:35.585214 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:32:35.620318 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:32:36.178808 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:32:36.184550 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.196082 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:32:36.262288 tst switch_tch_pdch.py: using LAC 33050 09:32:36.377648 tst switch_tch_pdch.py: using RAC 155 09:32:36.502660 tst switch_tch_pdch.py: using CellId 33050 09:32:36.625359 tst switch_tch_pdch.py: using BVCI 33051 09:32:36.738865 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.750814 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.762735 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.774342 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.786554 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.798821 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.811163 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:32:36.823301 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:32:36.939867 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:32:37.058700 tst switch_tch_pdch.py:51: start network... 09:32:37.268097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:37.750988 run create_hlr_db(pid=32580): Launched 09:32:37.876884 bus /gobi_6: Setting Powered False 09:32:38.939665 run create_hlr_db(pid=32580): Terminated: ok {rc=0} 09:32:39.374594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32582): Launched 09:32:39.685461 run osmo-hlr_10.42.42.2(pid=32583): Launched 09:32:39.804095 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:40.343587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32585): Launched 09:32:40.654479 run osmo-stp_10.42.42.5(pid=32586): Launched 09:32:40.772883 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:41.311477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32588): Launched 09:32:41.430163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:41.693136 run patchelf(pid=32589): Launched 09:32:41.865454 run osmo-stp_10.42.42.5(pid=32586): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32586)] 09:32:41.997912 run osmo-stp_10.42.42.5(pid=32586): stdout: | (launched: 2022-12-13_09:32:40.597273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:42.131199 run osmo-stp_10.42.42.5(pid=32586): stderr: | 20221213093240790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093240790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093240791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093240791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093240791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093240792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093240792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:42.264464 run osmo-stp_10.42.42.5(pid=32586): stdout: | (launched: 2022-12-13_09:32:40.597273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:42.392561 run osmo-stp_10.42.42.5(pid=32586): stderr: | 20221213093240790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093240790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093240791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093240791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093240791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093240792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093240792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:42.544024 run patchelf(pid=32589): Terminating (SIGINT) 09:32:42.718817 run patchelf(pid=32589): Terminated: ok {rc=0} 09:32:42.844497 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32586): Process ended prematurely: osmo-stp_10.42.42.5(pid=32586) [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32586)] [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:32:42.854079 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:32:42.881882 run osmo-hlr_10.42.42.2(pid=32583): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32583)] 09:32:42.931759 run osmo-hlr_10.42.42.2(pid=32583): stdout: | (launched: 2022-12-13_09:32:39.628555) 09:32:42.983244 run osmo-hlr_10.42.42.2(pid=32583): stderr: | 20221213093239828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093239828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093239828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093239828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093239828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093239828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093239841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093239851 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093239851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093239851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:43.034767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32582): Terminating (SIGTERM) 09:32:43.075864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32585): Terminating (SIGTERM) 09:32:43.117200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32588): Terminating (SIGTERM) 09:32:43.158589 --- ParallelTerminationStrategy: PID 32582 died... 09:32:43.178535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32582): Terminated: ok {rc=0} 09:32:43.223962 --- ParallelTerminationStrategy: PID 32585 died... 09:32:43.243339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32585): Terminated: ok {rc=0} 09:32:43.288649 --- ParallelTerminationStrategy: PID 32588 died... 09:32:43.308100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32588): Terminated: ok {rc=0} 09:32:43.394639 bus /gobi_0: Setting Powered False 09:32:44.490748 bus /gobi_0: Setting Powered False 09:32:45.605469 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:32:46.866280 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:46.875423 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:32:46.907427 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:32:46.944829 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:32:47.002592 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:32:47.039087 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:32:47.084646 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:32:47.619690 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:32:47.625798 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:47.637312 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:32:47.707894 tst switch_tch_pdch.py: using LAC 33051 09:32:47.830347 tst switch_tch_pdch.py: using RAC 156 09:32:47.957789 tst switch_tch_pdch.py: using CellId 33051 09:32:48.080560 tst switch_tch_pdch.py: using BVCI 33052 09:32:48.193917 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:48.205712 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:48.217281 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:48.228784 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:48.240022 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:48.251460 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:48.262918 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:32:48.274302 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:32:48.388057 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:32:48.506409 tst switch_tch_pdch.py:51: start network... 09:32:48.702609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:49.129130 run create_hlr_db(pid=32593): Launched 09:32:49.241223 bus /gobi_6: Setting Powered False 09:32:50.299258 run create_hlr_db(pid=32593): Terminated: ok {rc=0} 09:32:50.681637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32595): Launched 09:32:50.973597 run osmo-hlr_10.42.42.2(pid=32596): Launched 09:32:51.085259 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:51.561434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32598): Launched 09:32:51.851661 run osmo-stp_10.42.42.5(pid=32599): Launched 09:32:51.962797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:52.440475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32601): Launched 09:32:52.551348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:52.797626 run patchelf(pid=32602): Launched 09:32:52.959431 run osmo-stp_10.42.42.5(pid=32599): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32599)] 09:32:53.082765 run osmo-stp_10.42.42.5(pid=32599): stdout: | (launched: 2022-12-13_09:32:51.798454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:53.207872 run osmo-stp_10.42.42.5(pid=32599): stderr: | 20221213093251968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093251968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093251969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093251969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093251969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093251970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093251970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:53.332803 run osmo-stp_10.42.42.5(pid=32599): stdout: | (launched: 2022-12-13_09:32:51.798454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:53.452346 run osmo-stp_10.42.42.5(pid=32599): stderr: | 20221213093251968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093251968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093251969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093251969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093251969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093251970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093251970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:53.594230 run patchelf(pid=32602): Terminating (SIGINT) 09:32:53.757746 run patchelf(pid=32602): Terminated: ok {rc=0} 09:32:53.875883 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32599): Process ended prematurely: osmo-stp_10.42.42.5(pid=32599) [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32599)] [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:32:53.884689 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 09:32:53.911178 run osmo-hlr_10.42.42.2(pid=32596): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32596)] 09:32:53.958917 run osmo-hlr_10.42.42.2(pid=32596): stdout: | (launched: 2022-12-13_09:32:50.919955) 09:32:54.007844 run osmo-hlr_10.42.42.2(pid=32596): stderr: | 20221213093251095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093251095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093251095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093251095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093251095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093251095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093251125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093251135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093251135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093251135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:54.057193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32595): Terminating (SIGTERM) 09:32:54.096422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32598): Terminating (SIGTERM) 09:32:54.135606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32601): Terminating (SIGTERM) 09:32:54.175179 --- ParallelTerminationStrategy: PID 32595 died... 09:32:54.194229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32595): Terminated: ok {rc=0} 09:32:54.237580 --- ParallelTerminationStrategy: PID 32598 died... 09:32:54.255973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32598): Terminated: ok {rc=0} 09:32:54.299299 --- ParallelTerminationStrategy: PID 32601 died... 09:32:54.317899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32601): Terminated: ok {rc=0} 09:32:54.402716 bus /gobi_0: Setting Powered False 09:32:55.502121 bus /gobi_0: Setting Powered False 09:32:56.616045 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_sms:nanobts --------------------------------------------------------------------- 09:32:57.865616 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:57.869791 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 09:32:57.893900 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 09:32:57.901085 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 09:32:57.955486 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 09:32:57.980868 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 09:32:57.987932 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 09:32:58.523256 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 09:32:58.528733 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 09:32:58.539982 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 09:32:58.578342 tst mo_mt_sms.py: using LAC 33052 09:32:58.703590 tst mo_mt_sms.py: using RAC 157 09:32:58.828244 tst mo_mt_sms.py: using CellId 33052 09:32:58.952692 tst mo_mt_sms.py: using BVCI 33053 09:32:59.067045 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:32:59.182958 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:32:59.299565 tst mo_mt_sms.py:9: start nitb and bts... 09:32:59.509345 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:33:00.143989 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32606): Launched 09:33:00.454471 run osmo-nitb_10.42.42.2(pid=32607): Launched 09:33:00.626549 run osmo-nitb_10.42.42.2(pid=32607): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32607)] 09:33:00.766187 run osmo-nitb_10.42.42.2(pid=32607): stdout: | (launched: 2022-12-13_09:33:00.397952) 09:33:00.911727 run osmo-nitb_10.42.42.2(pid=32607): stderr: | (launched: 2022-12-13_09:33:00.444300) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:33:01.067874 run osmo-nitb_10.42.42.2(pid=32607): stdout: | (launched: 2022-12-13_09:33:00.397952) 09:33:01.206629 run osmo-nitb_10.42.42.2(pid=32607): stderr: | (launched: 2022-12-13_09:33:00.444300) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32607) [trial-2387↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32607)] 09:33:01.570722 tst osmo-nitb_10.42.42.2(pid=32607): stdout: | (launched: 2022-12-13_09:33:00.397952) 09:33:01.703807 tst osmo-nitb_10.42.42.2(pid=32607): stderr: | (launched: 2022-12-13_09:33:00.444300) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:33:01.855804 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32607) [trial-2387↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32607)] [trial-2387↪nitb_sms:nanobts↪mo_mt_sms.py:11] 09:33:01.865238 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 09:33:01.872713 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32606): Terminating (SIGTERM) 09:33:02.084285 --- ParallelTerminationStrategy: PID 32606 died... 09:33:02.104664 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32606): Terminated: ok {rc=0} 09:33:02.194639 bus /sierra_3: Setting Powered False 09:33:03.294029 bus /sierra_3: Setting Powered False 09:33:04.411728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:nanobts+band-1900 --------------------------------------------------------------------- 09:33:05.598812 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:05.604583 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:33:05.627980 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:33:05.654436 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 09:33:05.707850 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:33:05.732072 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:33:05.758480 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 09:33:06.302656 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 09:33:06.307807 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:06.318637 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:33:06.355348 tst mo_mt_sms.py: using LAC 33053 09:33:06.478964 tst mo_mt_sms.py: using RAC 158 09:33:06.595519 tst mo_mt_sms.py: using CellId 33053 09:33:06.719711 tst mo_mt_sms.py: using BVCI 33054 09:33:06.827244 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:06.838010 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:06.848701 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:06.859234 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:06.870708 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:06.882120 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:33:07.002496 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:33:07.120488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:07.574952 run create_hlr_db(pid=32613): Launched 09:33:07.687288 bus /sierra_2: Setting Powered False 09:33:08.745946 run create_hlr_db(pid=32613): Terminated: ok {rc=0} 09:33:09.174126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32615): Launched 09:33:09.485184 run osmo-hlr_10.42.42.2(pid=32616): Launched 09:33:09.605052 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:10.141573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32618): Launched 09:33:10.451764 run osmo-stp_10.42.42.5(pid=32619): Launched 09:33:10.570398 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:11.134575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32621): Launched 09:33:11.445200 run osmo-msc_10.42.42.6(pid=32622): Launched 09:33:11.620709 run osmo-stp_10.42.42.5(pid=32619): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32619)] 09:33:11.753634 run osmo-stp_10.42.42.5(pid=32619): stdout: | (launched: 2022-12-13_09:33:10.395239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:11.886900 run osmo-stp_10.42.42.5(pid=32619): stderr: | 20221213093310585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093310585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093310586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093310586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093310586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093310586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093310587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:12.019230 run osmo-stp_10.42.42.5(pid=32619): stdout: | (launched: 2022-12-13_09:33:10.395239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:12.143948 run osmo-stp_10.42.42.5(pid=32619): stderr: | 20221213093310585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093310585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093310586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093310586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093310586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093310586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093310587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:12.293046 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32619): Process ended prematurely: osmo-stp_10.42.42.5(pid=32619) [trial-2387↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32619)] [trial-2387↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 09:33:12.302128 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 09:33:12.329295 run osmo-hlr_10.42.42.2(pid=32616): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32616)] 09:33:12.379098 run osmo-hlr_10.42.42.2(pid=32616): stdout: | (launched: 2022-12-13_09:33:09.428659) 09:33:12.430973 run osmo-hlr_10.42.42.2(pid=32616): stderr: | 20221213093309626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093309627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093309627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093309627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093309627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093309627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093309639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093309649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093309649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093309650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:12.502918 run osmo-msc_10.42.42.6(pid=32622): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32622)] 09:33:12.552588 run osmo-msc_10.42.42.6(pid=32622): stdout: | (launched: 2022-12-13_09:33:11.388537) 09:33:12.603933 run osmo-msc_10.42.42.6(pid=32622): stderr: | 20221213093311708 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093311708 DLGLOBAL DEBUG validating counter group 0x7f9a340cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093311708 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093311708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093311709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093311709 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093311710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093311711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093311711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093311711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:12.655435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32615): Terminating (SIGTERM) 09:33:12.696807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32618): Terminating (SIGTERM) 09:33:12.738264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32621): Terminating (SIGTERM) 09:33:12.780609 --- ParallelTerminationStrategy: PID 32615 died... 09:33:12.800749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32615): Terminated: ok {rc=0} 09:33:12.847092 --- ParallelTerminationStrategy: PID 32618 died... 09:33:12.866961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32618): Terminated: ok {rc=0} 09:33:12.914061 --- ParallelTerminationStrategy: PID 32621 died... 09:33:12.933793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32621): Terminated: ok {rc=0} 09:33:13.021529 bus /sierra_3: Setting Powered False 09:33:14.120181 bus /sierra_3: Setting Powered False 09:33:15.235889 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:33:16.494447 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:16.502855 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:33:16.534615 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 09:33:16.544397 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:33:16.591242 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:33:16.631031 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 09:33:16.641174 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:33:17.163128 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:33:17.171188 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 09:33:17.184269 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:33:17.225382 tst assert_extension.py: using LAC 33054 09:33:17.348810 tst assert_extension.py: using RAC 159 09:33:17.462979 tst assert_extension.py: using CellId 33054 09:33:17.577624 tst assert_extension.py: using BVCI 33055 09:33:17.683031 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:33:17.800065 tst assert_extension.py:10: start nitb and bts... 09:33:18.010089 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:33:18.644828 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32627): Launched 09:33:18.956300 run osmo-nitb_10.42.42.2(pid=32628): Launched 09:33:19.128603 run osmo-nitb_10.42.42.2(pid=32628): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32628)] 09:33:19.267733 run osmo-nitb_10.42.42.2(pid=32628): stdout: | (launched: 2022-12-13_09:33:18.898961) 09:33:19.409062 run osmo-nitb_10.42.42.2(pid=32628): stderr: | (launched: 2022-12-13_09:33:18.946316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:33:19.550367 run osmo-nitb_10.42.42.2(pid=32628): stdout: | (launched: 2022-12-13_09:33:18.898961) 09:33:19.685853 run osmo-nitb_10.42.42.2(pid=32628): stderr: | (launched: 2022-12-13_09:33:18.946316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32628) [trial-2387↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32628)] 09:33:20.073698 tst osmo-nitb_10.42.42.2(pid=32628): stdout: | (launched: 2022-12-13_09:33:18.898961) 09:33:20.199028 tst osmo-nitb_10.42.42.2(pid=32628): stderr: | (launched: 2022-12-13_09:33:18.946316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:33:20.347960 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32628) [trial-2387↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32628)] [trial-2387↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 09:33:20.356909 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:33:20.363855 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32627): Terminating (SIGTERM) 09:33:20.573720 --- ParallelTerminationStrategy: PID 32627 died... 09:33:20.595469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32627): Terminated: ok {rc=0} 09:33:20.681560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:33:21.850093 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:21.855122 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:33:21.878945 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:33:21.906716 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:33:21.941296 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:33:21.965521 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:33:21.992714 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:33:22.523337 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:33:22.528526 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:22.539678 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:33:22.576937 tst assert_extension.py: using LAC 33055 09:33:22.697393 tst assert_extension.py: using RAC 160 09:33:22.817597 tst assert_extension.py: using CellId 33055 09:33:22.938936 tst assert_extension.py: using BVCI 33056 09:33:23.051904 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:23.063012 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:23.074073 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:23.084939 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:23.096003 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:33:23.107006 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:33:23.221734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:23.672116 run create_hlr_db(pid=32632): Launched 09:33:23.784024 bus /sierra_2: Setting Powered False 09:33:24.841246 run create_hlr_db(pid=32632): Terminated: ok {rc=0} 09:33:25.268101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Launched 09:33:25.580142 run osmo-hlr_10.42.42.2(pid=32635): Launched 09:33:25.699883 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:26.239575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32637): Launched 09:33:26.550900 run osmo-stp_10.42.42.5(pid=32638): Launched 09:33:26.670060 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:27.234924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32640): Launched 09:33:27.545362 run osmo-msc_10.42.42.6(pid=32641): Launched 09:33:27.719018 run osmo-stp_10.42.42.5(pid=32638): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32638)] 09:33:27.855586 run osmo-stp_10.42.42.5(pid=32638): stdout: | (launched: 2022-12-13_09:33:26.494198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:27.988650 run osmo-stp_10.42.42.5(pid=32638): stderr: | 20221213093326684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093326684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093326684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093326685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093326685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093326685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093326685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:28.120239 run osmo-stp_10.42.42.5(pid=32638): stdout: | (launched: 2022-12-13_09:33:26.494198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:28.245044 run osmo-stp_10.42.42.5(pid=32638): stderr: | 20221213093326684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093326684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093326684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093326685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093326685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093326685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093326685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:28.393898 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32638): Process ended prematurely: osmo-stp_10.42.42.5(pid=32638) [trial-2387↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32638)] [trial-2387↪ussd:nanobts+band-1900↪assert_extension.py:17] 09:33:28.402823 tst assert_extension.py:17: Test FAILED (5.9 sec) 09:33:28.430043 run osmo-hlr_10.42.42.2(pid=32635): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32635)] 09:33:28.480373 run osmo-hlr_10.42.42.2(pid=32635): stdout: | (launched: 2022-12-13_09:33:25.523357) 09:33:28.532578 run osmo-hlr_10.42.42.2(pid=32635): stderr: | 20221213093325720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093325720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093325720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093325720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093325720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093325720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093325733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093325741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093325741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093325741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:28.605004 run osmo-msc_10.42.42.6(pid=32641): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32641)] 09:33:28.654647 run osmo-msc_10.42.42.6(pid=32641): stdout: | (launched: 2022-12-13_09:33:27.488617) 09:33:28.706358 run osmo-msc_10.42.42.6(pid=32641): stderr: | 20221213093327809 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093327809 DLGLOBAL DEBUG validating counter group 0x7f9472d97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093327809 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093327809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093327810 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093327810 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093327811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093327812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093327812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093327812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:28.758321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Terminating (SIGTERM) 09:33:28.799528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32637): Terminating (SIGTERM) 09:33:28.841622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32640): Terminating (SIGTERM) 09:33:28.883568 --- ParallelTerminationStrategy: PID 32634 died... 09:33:28.903678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Terminated: ok {rc=0} 09:33:28.950046 --- ParallelTerminationStrategy: PID 32637 died... 09:33:28.970034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32637): Terminated: ok {rc=0} 09:33:29.016468 --- ParallelTerminationStrategy: PID 32640 died... 09:33:29.036072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32640): Terminated: ok {rc=0} 09:33:29.123427 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:33:30.323279 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:30.330923 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:33:30.354478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:33:30.382265 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:33:30.433328 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:33:30.458023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:33:30.486327 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:33:31.063178 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:33:31.117367 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:31.130448 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:33:31.191661 tst mo_mt_call.py: using LAC 33056 09:33:31.317589 tst mo_mt_call.py: using RAC 161 09:33:31.471673 tst mo_mt_call.py: using CellId 33056 09:33:31.593661 tst mo_mt_call.py: using BVCI 33057 09:33:31.712464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:31.726348 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:31.738768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:31.751490 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:31.764328 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:31.777128 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:33:31.905939 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:33:32.036103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:32.535516 run create_hlr_db(pid=32646): Launched 09:33:32.649174 bus /sierra_2: Setting Powered False 09:33:33.708802 run create_hlr_db(pid=32646): Terminated: ok {rc=0} 09:33:34.122542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32648): Launched 09:33:34.417780 run osmo-hlr_10.42.42.2(pid=32649): Launched 09:33:34.530970 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:35.052606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32651): Launched 09:33:35.348767 run osmo-stp_10.42.42.5(pid=32652): Launched 09:33:35.462293 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:35.999281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32654): Launched 09:33:36.296013 run osmo-msc_10.42.42.6(pid=32655): Launched 09:33:36.462984 run osmo-stp_10.42.42.5(pid=32652): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32652)] 09:33:36.590332 run osmo-stp_10.42.42.5(pid=32652): stdout: | (launched: 2022-12-13_09:33:35.294407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:36.717066 run osmo-stp_10.42.42.5(pid=32652): stderr: | 20221213093335463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093335463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093335464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093335464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093335465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093335465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093335465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:36.840885 run osmo-stp_10.42.42.5(pid=32652): stdout: | (launched: 2022-12-13_09:33:35.294407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:36.959765 run osmo-stp_10.42.42.5(pid=32652): stderr: | 20221213093335463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093335463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093335464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093335464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093335465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093335465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093335465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:37.102394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32652): Process ended prematurely: osmo-stp_10.42.42.5(pid=32652) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32652)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:33:37.111162 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:33:37.136918 run osmo-hlr_10.42.42.2(pid=32649): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32649)] 09:33:37.184876 run osmo-hlr_10.42.42.2(pid=32649): stdout: | (launched: 2022-12-13_09:33:34.363616) 09:33:37.233853 run osmo-hlr_10.42.42.2(pid=32649): stderr: | 20221213093334538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093334538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093334538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093334538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093334538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093334538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093334550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093334560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093334561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093334561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:37.302723 run osmo-msc_10.42.42.6(pid=32655): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32655)] 09:33:37.350082 run osmo-msc_10.42.42.6(pid=32655): stdout: | (launched: 2022-12-13_09:33:36.241616) 09:33:37.399059 run osmo-msc_10.42.42.6(pid=32655): stderr: | 20221213093336513 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093336513 DLGLOBAL DEBUG validating counter group 0x7fbc944e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093336513 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093336513 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093336513 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093336514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093336515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093336516 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093336516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093336516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:37.448201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32648): Terminating (SIGTERM) 09:33:37.487399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32651): Terminating (SIGTERM) 09:33:37.526520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32654): Terminating (SIGTERM) 09:33:37.565903 --- ParallelTerminationStrategy: PID 32648 died... 09:33:37.584920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32648): Terminated: ok {rc=0} 09:33:37.628581 --- ParallelTerminationStrategy: PID 32651 died... 09:33:37.647304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32651): Terminated: ok {rc=0} 09:33:37.690713 --- ParallelTerminationStrategy: PID 32654 died... 09:33:37.709402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32654): Terminated: ok {rc=0} 09:33:37.794737 bus /sierra_3: Setting Powered False 09:33:38.892414 bus /sierra_3: Setting Powered False 09:33:40.006809 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:33:41.147854 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:41.159518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:33:41.217977 tst mo_mt_call_osmux.py: using LAC 33057 09:33:41.334168 tst mo_mt_call_osmux.py: using RAC 162 09:33:41.451850 tst mo_mt_call_osmux.py: using CellId 33057 09:33:41.568204 tst mo_mt_call_osmux.py: using BVCI 33058 09:33:41.675290 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:41.686512 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:41.697514 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:41.708336 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:41.719674 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:33:41.730950 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:33:41.844644 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:33:41.960556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:42.419882 run create_hlr_db(pid=32657): Launched 09:33:42.533645 bus /sierra_2: Setting Powered False 09:33:43.594204 run create_hlr_db(pid=32657): Terminated: ok {rc=0} 09:33:44.007718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32659): Launched 09:33:44.305106 run osmo-hlr_10.42.42.2(pid=32660): Launched 09:33:44.418299 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:44.942137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32662): Launched 09:33:45.239998 run osmo-stp_10.42.42.5(pid=32664): Launched 09:33:45.353791 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:45.922999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32666): Launched 09:33:46.255582 run osmo-msc_10.42.42.6(pid=32667): Launched 09:33:46.759061 run osmo-stp_10.42.42.5(pid=32664): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] 09:33:46.959184 run osmo-stp_10.42.42.5(pid=32664): stdout: | (launched: 2022-12-13_09:33:45.185641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:47.095170 run osmo-stp_10.42.42.5(pid=32664): stderr: | 20221213093345356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093345356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093345357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093345357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093345358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093345358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093345358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:47.260041 run osmo-stp_10.42.42.5(pid=32664): stdout: | (launched: 2022-12-13_09:33:45.185641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:47.388451 run osmo-stp_10.42.42.5(pid=32664): stderr: | 20221213093345356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093345356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093345357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093345357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093345358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093345358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093345358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:47.537327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32664): Process ended prematurely: osmo-stp_10.42.42.5(pid=32664) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:33:47.546262 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:33:47.572385 run osmo-hlr_10.42.42.2(pid=32660): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32660)] 09:33:47.622038 run osmo-hlr_10.42.42.2(pid=32660): stdout: | (launched: 2022-12-13_09:33:44.250614) 09:33:47.672256 run osmo-hlr_10.42.42.2(pid=32660): stderr: | 20221213093344427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093344427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093344427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093344427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093344427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093344427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093344439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093344448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093344448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093344448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:47.742577 run osmo-msc_10.42.42.6(pid=32667): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32667)] 09:33:47.790013 run osmo-msc_10.42.42.6(pid=32667): stdout: | (launched: 2022-12-13_09:33:46.191070) 09:33:47.839851 run osmo-msc_10.42.42.6(pid=32667): stderr: | 20221213093346554 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093346554 DLGLOBAL DEBUG validating counter group 0x7f5d1a861c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093346554 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093346554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093346554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093346555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093346556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093346557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093346557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093346557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:47.890512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32659): Terminating (SIGTERM) 09:33:47.930849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32662): Terminating (SIGTERM) 09:33:47.971175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32666): Terminating (SIGTERM) 09:33:48.011665 --- ParallelTerminationStrategy: PID 32659 died... 09:33:48.031552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32659): Terminated: ok {rc=0} 09:33:48.076229 --- ParallelTerminationStrategy: PID 32662 died... 09:33:48.095654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32662): Terminated: ok {rc=0} 09:33:48.140164 --- ParallelTerminationStrategy: PID 32666 died... 09:33:48.159608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32666): Terminated: ok {rc=0} 09:33:48.246703 bus /sierra_3: Setting Powered False 09:33:49.344626 bus /sierra_3: Setting Powered False 09:33:50.457397 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:33:51.697546 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:51.705142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:33:51.728499 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:33:51.755189 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:33:51.806021 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:33:51.830144 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:33:51.857132 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:33:52.406625 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:33:52.454910 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:33:52.466238 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:33:52.525295 tst mo_mt_call.py: using LAC 33058 09:33:52.643523 tst mo_mt_call.py: using RAC 163 09:33:52.760325 tst mo_mt_call.py: using CellId 33058 09:33:52.876920 tst mo_mt_call.py: using BVCI 33059 09:33:52.984920 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:33:52.996372 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:33:53.007476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:33:53.018355 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:33:53.029780 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:33:53.040882 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:33:53.157491 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:33:53.277240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:53.768410 run create_hlr_db(pid=32672): Launched 09:33:53.898267 bus /sierra_2: Setting Powered False 09:33:54.961421 run create_hlr_db(pid=32672): Terminated: ok {rc=0} 09:33:55.385697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Launched 09:33:55.681674 run osmo-hlr_10.42.42.2(pid=32675): Launched 09:33:55.794767 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:56.318926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Launched 09:33:56.616126 run osmo-stp_10.42.42.5(pid=32678): Launched 09:33:56.730467 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:57.267177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Launched 09:33:57.563751 run osmo-msc_10.42.42.6(pid=32681): Launched 09:33:57.729261 run osmo-stp_10.42.42.5(pid=32678): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] 09:33:57.856576 run osmo-stp_10.42.42.5(pid=32678): stdout: | (launched: 2022-12-13_09:33:56.561910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:57.982749 run osmo-stp_10.42.42.5(pid=32678): stderr: | 20221213093356733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093356733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093356733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093356734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093356734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093356734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093356734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:58.106841 run osmo-stp_10.42.42.5(pid=32678): stdout: | (launched: 2022-12-13_09:33:56.561910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:58.225351 run osmo-stp_10.42.42.5(pid=32678): stderr: | 20221213093356733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093356733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093356733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093356734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093356734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093356734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093356734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:58.367331 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32678): Process ended prematurely: osmo-stp_10.42.42.5(pid=32678) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:33:58.376353 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:33:58.402473 run osmo-hlr_10.42.42.2(pid=32675): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32675)] 09:33:58.450613 run osmo-hlr_10.42.42.2(pid=32675): stdout: | (launched: 2022-12-13_09:33:55.627921) 09:33:58.499582 run osmo-hlr_10.42.42.2(pid=32675): stderr: | 20221213093355802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093355802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093355802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093355802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093355802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093355802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093355817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093355825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093355826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093355826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:58.568506 run osmo-msc_10.42.42.6(pid=32681): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32681)] 09:33:58.615380 run osmo-msc_10.42.42.6(pid=32681): stdout: | (launched: 2022-12-13_09:33:57.509757) 09:33:58.664389 run osmo-msc_10.42.42.6(pid=32681): stderr: | 20221213093357783 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093357783 DLGLOBAL DEBUG validating counter group 0x7f5ba4ab7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093357783 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093357783 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093357783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093357784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093357785 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093357786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093357786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093357786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:58.713665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Terminating (SIGTERM) 09:33:58.753201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Terminating (SIGTERM) 09:33:58.792725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Terminating (SIGTERM) 09:33:58.832624 --- ParallelTerminationStrategy: PID 32674 died... 09:33:58.852197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Terminated: ok {rc=0} 09:33:58.896526 --- ParallelTerminationStrategy: PID 32677 died... 09:33:58.915452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Terminated: ok {rc=0} 09:33:58.959113 --- ParallelTerminationStrategy: PID 32680 died... 09:33:58.977920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Terminated: ok {rc=0} 09:33:59.060513 bus /sierra_3: Setting Powered False 09:34:00.157165 bus /sierra_3: Setting Powered False 09:34:01.276681 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:34:02.437784 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:34:02.449856 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:34:02.510839 tst mo_mt_call_osmux.py: using LAC 33059 09:34:02.634661 tst mo_mt_call_osmux.py: using RAC 164 09:34:02.759703 tst mo_mt_call_osmux.py: using CellId 33059 09:34:02.885786 tst mo_mt_call_osmux.py: using BVCI 33060 09:34:03.002925 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:34:03.014637 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:34:03.026125 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:34:03.037661 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:34:03.049262 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:34:03.060660 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:34:03.178457 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:34:03.295465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:03.757834 run create_hlr_db(pid=32683): Launched 09:34:03.871762 bus /sierra_2: Setting Powered False 09:34:04.931631 run create_hlr_db(pid=32683): Terminated: ok {rc=0} 09:34:05.367146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32685): Launched 09:34:05.684279 run osmo-hlr_10.42.42.2(pid=32686): Launched 09:34:05.805657 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:06.351892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32688): Launched 09:34:06.668209 run osmo-stp_10.42.42.5(pid=32689): Launched 09:34:06.788775 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:07.361732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32691): Launched 09:34:07.678865 run osmo-msc_10.42.42.6(pid=32692): Launched 09:34:07.856010 run osmo-stp_10.42.42.5(pid=32689): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32689)] 09:34:07.995128 run osmo-stp_10.42.42.5(pid=32689): stdout: | (launched: 2022-12-13_09:34:06.610417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:08.129098 run osmo-stp_10.42.42.5(pid=32689): stderr: | 20221213093406803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093406803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093406803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093406804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093406804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093406804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093406804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:08.261376 run osmo-stp_10.42.42.5(pid=32689): stdout: | (launched: 2022-12-13_09:34:06.610417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:08.388304 run osmo-stp_10.42.42.5(pid=32689): stderr: | 20221213093406803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093406803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093406803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093406804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093406804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093406804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093406804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:08.540177 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32689): Process ended prematurely: osmo-stp_10.42.42.5(pid=32689) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32689)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:34:08.550046 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:34:08.577772 run osmo-hlr_10.42.42.2(pid=32686): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32686)] 09:34:08.627921 run osmo-hlr_10.42.42.2(pid=32686): stdout: | (launched: 2022-12-13_09:34:05.626971) 09:34:08.679441 run osmo-hlr_10.42.42.2(pid=32686): stderr: | 20221213093405825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093405825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093405825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093405825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093405825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093405825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093405838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093405848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093405848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093405848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:08.751849 run osmo-msc_10.42.42.6(pid=32692): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32692)] 09:34:08.801669 run osmo-msc_10.42.42.6(pid=32692): stdout: | (launched: 2022-12-13_09:34:07.621400) 09:34:08.853342 run osmo-msc_10.42.42.6(pid=32692): stderr: | 20221213093407946 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093407946 DLGLOBAL DEBUG validating counter group 0x7fc20971fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093407946 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093407946 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093407947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093407947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093407948 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093407949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093407949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093407949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:08.905683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32685): Terminating (SIGTERM) 09:34:08.947833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32688): Terminating (SIGTERM) 09:34:08.989626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32691): Terminating (SIGTERM) 09:34:09.031654 --- ParallelTerminationStrategy: PID 32685 died... 09:34:09.051480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32685): Terminated: ok {rc=0} 09:34:09.096858 --- ParallelTerminationStrategy: PID 32688 died... 09:34:09.116650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32688): Terminated: ok {rc=0} 09:34:09.162041 --- ParallelTerminationStrategy: PID 32691 died... 09:34:09.181480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32691): Terminated: ok {rc=0} 09:34:09.268418 bus /sierra_3: Setting Powered False 09:34:10.365299 bus /sierra_3: Setting Powered False 09:34:11.481440 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:34:12.724788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:12.732681 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:34:12.757180 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:34:12.784512 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:34:12.835534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:34:12.859165 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:34:12.886006 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:34:13.445871 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:34:13.499000 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:13.510916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:34:13.570265 tst mo_mt_call.py: using LAC 33060 09:34:13.693604 tst mo_mt_call.py: using RAC 165 09:34:13.816661 tst mo_mt_call.py: using CellId 33060 09:34:13.939743 tst mo_mt_call.py: using BVCI 33061 09:34:14.055254 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:14.066924 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:14.078392 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:14.089808 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:14.101498 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:14.113513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:34:14.230085 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:34:14.349796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:14.839480 run create_hlr_db(pid=32697): Launched 09:34:14.968182 bus /sierra_2: Setting Powered False 09:34:16.030791 run create_hlr_db(pid=32697): Terminated: ok {rc=0} 09:34:16.487395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32699): Launched 09:34:16.826276 run osmo-hlr_10.42.42.2(pid=32700): Launched 09:34:16.996191 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:17.617680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32702): Launched 09:34:17.914340 run osmo-stp_10.42.42.5(pid=32703): Launched 09:34:18.028012 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:18.563429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32705): Launched 09:34:18.861036 run osmo-msc_10.42.42.6(pid=32706): Launched 09:34:19.027563 run osmo-stp_10.42.42.5(pid=32703): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32703)] 09:34:19.154329 run osmo-stp_10.42.42.5(pid=32703): stdout: | (launched: 2022-12-13_09:34:17.860059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:19.280458 run osmo-stp_10.42.42.5(pid=32703): stderr: | 20221213093418030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093418030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093418030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093418031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093418031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093418031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093418031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:19.404634 run osmo-stp_10.42.42.5(pid=32703): stdout: | (launched: 2022-12-13_09:34:17.860059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:19.523307 run osmo-stp_10.42.42.5(pid=32703): stderr: | 20221213093418030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093418030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093418030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093418031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093418031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093418031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093418031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:19.664887 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32703): Process ended prematurely: osmo-stp_10.42.42.5(pid=32703) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32703)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:34:19.673739 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:34:19.699666 run osmo-hlr_10.42.42.2(pid=32700): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32700)] 09:34:19.747135 run osmo-hlr_10.42.42.2(pid=32700): stdout: | (launched: 2022-12-13_09:34:16.763466) 09:34:19.796066 run osmo-hlr_10.42.42.2(pid=32700): stderr: | 20221213093417117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093417117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093417117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093417117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093417117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093417117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093417135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093417148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093417148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093417148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:19.864616 run osmo-msc_10.42.42.6(pid=32706): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32706)] 09:34:19.911631 run osmo-msc_10.42.42.6(pid=32706): stdout: | (launched: 2022-12-13_09:34:18.806741) 09:34:19.960551 run osmo-msc_10.42.42.6(pid=32706): stderr: | 20221213093419078 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093419078 DLGLOBAL DEBUG validating counter group 0x7fc9ef5a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093419078 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093419078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093419078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093419079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093419080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093419081 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093419081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093419081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:20.010029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32699): Terminating (SIGTERM) 09:34:20.049414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32702): Terminating (SIGTERM) 09:34:20.088844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32705): Terminating (SIGTERM) 09:34:20.128682 --- ParallelTerminationStrategy: PID 32699 died... 09:34:20.147894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32699): Terminated: ok {rc=0} 09:34:20.191473 --- ParallelTerminationStrategy: PID 32702 died... 09:34:20.210199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32702): Terminated: ok {rc=0} 09:34:20.253494 --- ParallelTerminationStrategy: PID 32705 died... 09:34:20.272074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32705): Terminated: ok {rc=0} 09:34:20.357674 bus /sierra_3: Setting Powered False 09:34:21.455704 bus /sierra_3: Setting Powered False 09:34:22.566282 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:34:23.713187 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:23.725682 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:34:23.787907 tst mo_mt_call_osmux.py: using LAC 33061 09:34:23.911976 tst mo_mt_call_osmux.py: using RAC 166 09:34:24.037059 tst mo_mt_call_osmux.py: using CellId 33061 09:34:24.161174 tst mo_mt_call_osmux.py: using BVCI 33062 09:34:24.275721 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:24.287407 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:24.298886 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:24.310429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:24.322023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:34:24.333482 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:34:24.450148 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:34:24.570992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:25.062313 run create_hlr_db(pid=32708): Launched 09:34:25.190537 bus /sierra_2: Setting Powered False 09:34:26.254067 run create_hlr_db(pid=32708): Terminated: ok {rc=0} 09:34:26.676662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32710): Launched 09:34:26.973671 run osmo-hlr_10.42.42.2(pid=32711): Launched 09:34:27.087305 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:27.602361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32713): Launched 09:34:27.898233 run osmo-stp_10.42.42.5(pid=32714): Launched 09:34:28.011149 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:28.552586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32716): Launched 09:34:28.851200 run osmo-msc_10.42.42.6(pid=32717): Launched 09:34:29.018169 run osmo-stp_10.42.42.5(pid=32714): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32714)] 09:34:29.145960 run osmo-stp_10.42.42.5(pid=32714): stdout: | (launched: 2022-12-13_09:34:27.844242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:29.272650 run osmo-stp_10.42.42.5(pid=32714): stderr: | 20221213093428014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093428014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093428014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093428015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093428015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093428015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093428015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:29.397344 run osmo-stp_10.42.42.5(pid=32714): stdout: | (launched: 2022-12-13_09:34:27.844242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:29.516593 run osmo-stp_10.42.42.5(pid=32714): stderr: | 20221213093428014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093428014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093428014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093428015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093428015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093428015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093428015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:29.659078 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32714): Process ended prematurely: osmo-stp_10.42.42.5(pid=32714) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32714)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:34:29.668190 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:34:29.694329 run osmo-hlr_10.42.42.2(pid=32711): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32711)] 09:34:29.742373 run osmo-hlr_10.42.42.2(pid=32711): stdout: | (launched: 2022-12-13_09:34:26.919697) 09:34:29.791638 run osmo-hlr_10.42.42.2(pid=32711): stderr: | 20221213093427092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093427092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093427092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093427092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093427092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093427093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093427105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093427113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093427113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093427113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:29.860754 run osmo-msc_10.42.42.6(pid=32717): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32717)] 09:34:29.907818 run osmo-msc_10.42.42.6(pid=32717): stdout: | (launched: 2022-12-13_09:34:28.796501) 09:34:29.956731 run osmo-msc_10.42.42.6(pid=32717): stderr: | 20221213093429067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093429067 DLGLOBAL DEBUG validating counter group 0x7f6ff81e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093429067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093429067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093429067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093429068 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093429069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093429070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093429070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093429070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:30.006278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32710): Terminating (SIGTERM) 09:34:30.045749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32713): Terminating (SIGTERM) 09:34:30.085357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32716): Terminating (SIGTERM) 09:34:30.125741 --- ParallelTerminationStrategy: PID 32710 died... 09:34:30.145011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32710): Terminated: ok {rc=0} 09:34:30.189153 --- ParallelTerminationStrategy: PID 32713 died... 09:34:30.207952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32713): Terminated: ok {rc=0} 09:34:30.251745 --- ParallelTerminationStrategy: PID 32716 died... 09:34:30.270581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32716): Terminated: ok {rc=0} 09:34:30.355999 bus /sierra_3: Setting Powered False 09:34:31.476267 bus /sierra_3: Setting Powered False 09:34:32.591102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:34:33.830027 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:33.838389 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:34:33.862874 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:34:33.891037 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:34:33.946902 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:34:33.972340 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:34:33.999416 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:34:34.545239 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:34:34.593847 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:34.605253 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:34:34.668547 tst mo_mt_call.py: using LAC 33062 09:34:34.785384 tst mo_mt_call.py: using RAC 167 09:34:34.903062 tst mo_mt_call.py: using CellId 33062 09:34:35.017898 tst mo_mt_call.py: using BVCI 33063 09:34:35.125128 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:35.136238 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:35.147199 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:35.158193 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:35.169548 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:35.180830 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:34:35.300420 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:34:35.417864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:35.879109 run create_hlr_db(pid=32722): Launched 09:34:35.992530 bus /sierra_2: Setting Powered False 09:34:37.052622 run create_hlr_db(pid=32722): Terminated: ok {rc=0} 09:34:37.467491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32724): Launched 09:34:37.764930 run osmo-hlr_10.42.42.2(pid=32725): Launched 09:34:37.878221 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:38.406908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32727): Launched 09:34:38.703398 run osmo-stp_10.42.42.5(pid=32728): Launched 09:34:38.816476 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:39.351716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32730): Launched 09:34:39.649207 run osmo-msc_10.42.42.6(pid=32731): Launched 09:34:39.815160 run osmo-stp_10.42.42.5(pid=32728): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32728)] 09:34:39.941499 run osmo-stp_10.42.42.5(pid=32728): stdout: | (launched: 2022-12-13_09:34:38.649408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:40.067594 run osmo-stp_10.42.42.5(pid=32728): stderr: | 20221213093438822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093438822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093438822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093438823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093438823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093438823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093438823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:40.192006 run osmo-stp_10.42.42.5(pid=32728): stdout: | (launched: 2022-12-13_09:34:38.649408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:40.311078 run osmo-stp_10.42.42.5(pid=32728): stderr: | 20221213093438822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093438822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093438822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093438823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093438823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093438823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093438823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:40.454065 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32728): Process ended prematurely: osmo-stp_10.42.42.5(pid=32728) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32728)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:34:40.463063 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:34:40.489270 run osmo-hlr_10.42.42.2(pid=32725): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32725)] 09:34:40.537343 run osmo-hlr_10.42.42.2(pid=32725): stdout: | (launched: 2022-12-13_09:34:37.710931) 09:34:40.587026 run osmo-hlr_10.42.42.2(pid=32725): stderr: | 20221213093437886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093437886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093437886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093437886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093437886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093437886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093437898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093437907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093437907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093437907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:40.656569 run osmo-msc_10.42.42.6(pid=32731): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32731)] 09:34:40.703805 run osmo-msc_10.42.42.6(pid=32731): stdout: | (launched: 2022-12-13_09:34:39.594853) 09:34:40.753137 run osmo-msc_10.42.42.6(pid=32731): stderr: | 20221213093439865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093439865 DLGLOBAL DEBUG validating counter group 0x7f1d5af0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093439865 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093439865 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093439865 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093439866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093439867 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093439868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093439868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093439868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:40.802913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32724): Terminating (SIGTERM) 09:34:40.842731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32727): Terminating (SIGTERM) 09:34:40.882483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32730): Terminating (SIGTERM) 09:34:40.922701 --- ParallelTerminationStrategy: PID 32724 died... 09:34:40.942148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32724): Terminated: ok {rc=0} 09:34:40.986687 --- ParallelTerminationStrategy: PID 32727 died... 09:34:41.005499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32727): Terminated: ok {rc=0} 09:34:41.049255 --- ParallelTerminationStrategy: PID 32730 died... 09:34:41.068139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32730): Terminated: ok {rc=0} 09:34:41.154198 bus /sierra_3: Setting Powered False 09:34:42.251944 bus /sierra_3: Setting Powered False 09:34:43.363894 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:34:44.510180 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:44.522575 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:34:44.584252 tst mo_mt_call_osmux.py: using LAC 33063 09:34:44.703397 tst mo_mt_call_osmux.py: using RAC 168 09:34:44.822702 tst mo_mt_call_osmux.py: using CellId 33063 09:34:44.941132 tst mo_mt_call_osmux.py: using BVCI 33064 09:34:45.050693 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:45.062140 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:45.073603 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:45.084408 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:45.095863 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:34:45.107279 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:34:45.225732 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:34:45.341950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:45.804106 run create_hlr_db(pid=32733): Launched 09:34:45.940841 bus /sierra_2: Setting Powered False 09:34:47.019253 run create_hlr_db(pid=32733): Terminated: ok {rc=0} 09:34:47.479327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32735): Launched 09:34:47.777283 run osmo-hlr_10.42.42.2(pid=32736): Launched 09:34:47.890213 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:48.398956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32738): Launched 09:34:48.695799 run osmo-stp_10.42.42.5(pid=32739): Launched 09:34:48.808771 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:49.345073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32741): Launched 09:34:49.641489 run osmo-msc_10.42.42.6(pid=32742): Launched 09:34:49.807719 run osmo-stp_10.42.42.5(pid=32739): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32739)] 09:34:49.933490 run osmo-stp_10.42.42.5(pid=32739): stdout: | (launched: 2022-12-13_09:34:48.641376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:50.059573 run osmo-stp_10.42.42.5(pid=32739): stderr: | 20221213093448811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093448811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093448811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093448812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093448812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093448812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093448812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:50.183477 run osmo-stp_10.42.42.5(pid=32739): stdout: | (launched: 2022-12-13_09:34:48.641376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:50.302295 run osmo-stp_10.42.42.5(pid=32739): stderr: | 20221213093448811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093448811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093448811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093448812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093448812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093448812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093448812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:50.444415 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32739): Process ended prematurely: osmo-stp_10.42.42.5(pid=32739) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32739)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:34:50.453611 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:34:50.479988 run osmo-hlr_10.42.42.2(pid=32736): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32736)] 09:34:50.528320 run osmo-hlr_10.42.42.2(pid=32736): stdout: | (launched: 2022-12-13_09:34:47.723318) 09:34:50.577904 run osmo-hlr_10.42.42.2(pid=32736): stderr: | 20221213093447900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093447900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093447900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093447900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093447900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093447901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093447913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093447921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093447922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093447922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:50.647633 run osmo-msc_10.42.42.6(pid=32742): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32742)] 09:34:50.695227 run osmo-msc_10.42.42.6(pid=32742): stdout: | (launched: 2022-12-13_09:34:49.587111) 09:34:50.744459 run osmo-msc_10.42.42.6(pid=32742): stderr: | 20221213093449861 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093449861 DLGLOBAL DEBUG validating counter group 0x7f644ad30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093449861 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093449861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093449862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093449862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093449863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093449864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093449864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093449864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:50.793967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32735): Terminating (SIGTERM) 09:34:50.833762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32738): Terminating (SIGTERM) 09:34:50.873455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32741): Terminating (SIGTERM) 09:34:50.913767 --- ParallelTerminationStrategy: PID 32735 died... 09:34:50.933038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32735): Terminated: ok {rc=0} 09:34:50.976831 --- ParallelTerminationStrategy: PID 32738 died... 09:34:50.996298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32738): Terminated: ok {rc=0} 09:34:51.039852 --- ParallelTerminationStrategy: PID 32741 died... 09:34:51.058615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32741): Terminated: ok {rc=0} 09:34:51.143656 bus /sierra_3: Setting Powered False 09:34:52.242242 bus /sierra_3: Setting Powered False 09:34:53.355552 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:34:54.590733 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:54.598057 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:34:54.621336 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:34:54.649318 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:34:54.699224 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:34:54.722976 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:34:54.749961 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:34:55.303690 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:34:55.352086 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:34:55.363495 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:34:55.421706 tst mo_mt_call.py: using LAC 33064 09:34:55.545114 tst mo_mt_call.py: using RAC 169 09:34:55.660430 tst mo_mt_call.py: using CellId 33064 09:34:55.780011 tst mo_mt_call.py: using BVCI 33065 09:34:55.898149 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:34:55.909832 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:34:55.921464 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:34:55.933001 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:34:55.944532 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:34:55.956049 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:34:56.076124 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:34:56.191291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:56.652245 run create_hlr_db(pid=32747): Launched 09:34:56.765955 bus /sierra_2: Setting Powered False 09:34:57.825345 run create_hlr_db(pid=32747): Terminated: ok {rc=0} 09:34:58.259860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32749): Launched 09:34:58.576692 run osmo-hlr_10.42.42.2(pid=32750): Launched 09:34:58.698268 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:59.227505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32752): Launched 09:34:59.524807 run osmo-stp_10.42.42.5(pid=32753): Launched 09:34:59.638278 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:00.178152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32755): Launched 09:35:00.475611 run osmo-msc_10.42.42.6(pid=32756): Launched 09:35:00.643312 run osmo-stp_10.42.42.5(pid=32753): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32753)] 09:35:00.770513 run osmo-stp_10.42.42.5(pid=32753): stdout: | (launched: 2022-12-13_09:34:59.470414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:00.899384 run osmo-stp_10.42.42.5(pid=32753): stderr: | 20221213093459638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093459638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093459639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093459639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093459640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093459640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093459640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:01.027218 run osmo-stp_10.42.42.5(pid=32753): stdout: | (launched: 2022-12-13_09:34:59.470414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:01.157455 run osmo-stp_10.42.42.5(pid=32753): stderr: | 20221213093459638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093459638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093459639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093459639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093459640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093459640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093459640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:01.305891 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32753): Process ended prematurely: osmo-stp_10.42.42.5(pid=32753) [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32753)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:35:01.315954 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:35:01.343598 run osmo-hlr_10.42.42.2(pid=32750): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32750)] 09:35:01.396587 run osmo-hlr_10.42.42.2(pid=32750): stdout: | (launched: 2022-12-13_09:34:58.519060) 09:35:01.447301 run osmo-hlr_10.42.42.2(pid=32750): stderr: | 20221213093458717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093458717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093458718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093458718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093458718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093458718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093458730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093458738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093458738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093458738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:01.519926 run osmo-msc_10.42.42.6(pid=32756): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32756)] 09:35:01.569151 run osmo-msc_10.42.42.6(pid=32756): stdout: | (launched: 2022-12-13_09:35:00.421295) 09:35:01.620541 run osmo-msc_10.42.42.6(pid=32756): stderr: | 20221213093500693 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093500693 DLGLOBAL DEBUG validating counter group 0x7f71d9fbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093500694 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093500694 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093500694 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093500694 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093500696 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093500696 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093500696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093500696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:01.673931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32749): Terminating (SIGTERM) 09:35:01.715282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32752): Terminating (SIGTERM) 09:35:01.758897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32755): Terminating (SIGTERM) 09:35:01.801041 --- ParallelTerminationStrategy: PID 32749 died... 09:35:01.821769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32749): Terminated: ok {rc=0} 09:35:01.868441 --- ParallelTerminationStrategy: PID 32752 died... 09:35:01.889752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32752): Terminated: ok {rc=0} 09:35:01.935568 --- ParallelTerminationStrategy: PID 32755 died... 09:35:01.956348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32755): Terminated: ok {rc=0} 09:35:02.042990 bus /sierra_3: Setting Powered False 09:35:03.141371 bus /sierra_3: Setting Powered False 09:35:04.259210 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:35:05.403456 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:35:05.415400 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:35:05.475364 tst mo_mt_call_osmux.py: using LAC 33065 09:35:05.592901 tst mo_mt_call_osmux.py: using RAC 170 09:35:05.710527 tst mo_mt_call_osmux.py: using CellId 33065 09:35:05.829236 tst mo_mt_call_osmux.py: using BVCI 33066 09:35:05.936843 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:35:05.948238 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:35:05.959224 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:35:05.970268 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:35:05.981963 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:35:05.993225 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:35:06.112510 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:35:06.229906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:06.690150 run create_hlr_db(pid=32761): Launched 09:35:06.803225 bus /sierra_2: Setting Powered False 09:35:07.863763 run create_hlr_db(pid=32761): Terminated: ok {rc=0} 09:35:08.278447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32763): Launched 09:35:08.575451 run osmo-hlr_10.42.42.2(pid=32764): Launched 09:35:08.689366 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:09.217161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32766): Launched 09:35:09.515174 run osmo-stp_10.42.42.5(pid=32767): Launched 09:35:09.629648 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:10.168770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=301): Launched 09:35:10.466036 run osmo-msc_10.42.42.6(pid=302): Launched 09:35:10.632852 run osmo-stp_10.42.42.5(pid=32767): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32767)] 09:35:10.759590 run osmo-stp_10.42.42.5(pid=32767): stdout: | (launched: 2022-12-13_09:35:09.460732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:10.885838 run osmo-stp_10.42.42.5(pid=32767): stderr: | 20221213093509631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093509631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093509631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093509632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093509632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093509632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093509633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:11.010550 run osmo-stp_10.42.42.5(pid=32767): stdout: | (launched: 2022-12-13_09:35:09.460732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:11.129861 run osmo-stp_10.42.42.5(pid=32767): stderr: | 20221213093509631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093509631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093509631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093509632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093509632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093509632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093509633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:11.271805 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32767): Process ended prematurely: osmo-stp_10.42.42.5(pid=32767) [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32767)] [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:35:11.280703 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 09:35:11.307059 run osmo-hlr_10.42.42.2(pid=32764): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32764)] 09:35:11.355160 run osmo-hlr_10.42.42.2(pid=32764): stdout: | (launched: 2022-12-13_09:35:08.521051) 09:35:11.404364 run osmo-hlr_10.42.42.2(pid=32764): stderr: | 20221213093508696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093508696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093508696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093508696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093508696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093508696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093508707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093508716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093508716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093508716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:11.473631 run osmo-msc_10.42.42.6(pid=302): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=302)] 09:35:11.520612 run osmo-msc_10.42.42.6(pid=302): stdout: | (launched: 2022-12-13_09:35:10.411713) 09:35:11.570464 run osmo-msc_10.42.42.6(pid=302): stderr: | 20221213093510685 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093510685 DLGLOBAL DEBUG validating counter group 0x7fe3a30c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093510685 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093510685 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093510685 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093510685 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093510687 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093510687 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093510688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093510688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:11.620319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32763): Terminating (SIGTERM) 09:35:11.660062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32766): Terminating (SIGTERM) 09:35:11.699766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=301): Terminating (SIGTERM) 09:35:11.739755 --- ParallelTerminationStrategy: PID 32763 died... 09:35:11.759221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32763): Terminated: ok {rc=0} 09:35:11.803196 --- ParallelTerminationStrategy: PID 32766 died... 09:35:11.822557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32766): Terminated: ok {rc=0} 09:35:11.866581 --- ParallelTerminationStrategy: PID 301 died... 09:35:11.885946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=301): Terminated: ok {rc=0} 09:35:11.971533 bus /sierra_3: Setting Powered False 09:35:13.070317 bus /sierra_3: Setting Powered False 09:35:14.183704 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:nanobts+band-1900 --------------------------------------------------------------------- 09:35:15.421995 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:35:15.427186 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:35:15.450229 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:35:15.477752 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:35:15.561475 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:35:15.584820 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:35:15.611319 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:35:16.226253 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 09:35:16.232018 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:16.243485 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:35:16.285024 tst emergency_mo_mt_call.py: using LAC 33066 09:35:16.433865 tst emergency_mo_mt_call.py: using RAC 171 09:35:16.568490 tst emergency_mo_mt_call.py: using CellId 33066 09:35:16.719852 tst emergency_mo_mt_call.py: using BVCI 33067 09:35:16.863554 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:16.878263 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:16.893129 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:16.908156 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:16.923740 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:16.937722 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:17.079594 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:17.222593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:17.682819 run create_hlr_db(pid=310): Launched 09:35:17.794239 bus /sierra_2: Setting Powered False 09:35:18.852656 run create_hlr_db(pid=310): Terminated: ok {rc=0} 09:35:19.257805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=312): Launched 09:35:19.548544 run osmo-hlr_10.42.42.2(pid=313): Launched 09:35:19.659324 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:20.163038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=315): Launched 09:35:20.453675 run osmo-stp_10.42.42.5(pid=316): Launched 09:35:20.574268 tst emergency_mo_mt_call.py: using MSISDN 8084 09:35:20.726679 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:21.251219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=318): Launched 09:35:21.542095 run osmo-msc_10.42.42.6(pid=319): Launched 09:35:21.705829 run osmo-stp_10.42.42.5(pid=316): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=316)] 09:35:21.830184 run osmo-stp_10.42.42.5(pid=316): stdout: | (launched: 2022-12-13_09:35:20.400197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:21.955974 run osmo-stp_10.42.42.5(pid=316): stderr: | 20221213093520572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093520572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093520572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093520573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093520574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093520574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093520574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:22.077750 run osmo-stp_10.42.42.5(pid=316): stdout: | (launched: 2022-12-13_09:35:20.400197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:22.194007 run osmo-stp_10.42.42.5(pid=316): stderr: | 20221213093520572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093520572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093520572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093520573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093520574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093520574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093520574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:22.332920 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=316): Process ended prematurely: osmo-stp_10.42.42.5(pid=316) [trial-2387↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=316)] [trial-2387↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 09:35:22.341440 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 09:35:22.367559 run osmo-hlr_10.42.42.2(pid=313): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=313)] 09:35:22.414903 run osmo-hlr_10.42.42.2(pid=313): stdout: | (launched: 2022-12-13_09:35:19.494981) 09:35:22.464187 run osmo-hlr_10.42.42.2(pid=313): stderr: | 20221213093519671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093519671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093519671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093519671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093519671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093519671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093519685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093519694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093519694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093519695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:22.533160 run osmo-msc_10.42.42.6(pid=319): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=319)] 09:35:22.580144 run osmo-msc_10.42.42.6(pid=319): stdout: | (launched: 2022-12-13_09:35:21.488365) 09:35:22.629140 run osmo-msc_10.42.42.6(pid=319): stderr: | 20221213093521757 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093521757 DLGLOBAL DEBUG validating counter group 0x7fd700a01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093521757 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093521757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093521758 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093521758 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093521760 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093521760 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093521760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093521760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:22.678236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=312): Terminating (SIGTERM) 09:35:22.717784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=315): Terminating (SIGTERM) 09:35:22.757630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=318): Terminating (SIGTERM) 09:35:22.797499 --- ParallelTerminationStrategy: PID 312 died... 09:35:22.816893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=312): Terminated: ok {rc=0} 09:35:22.860616 --- ParallelTerminationStrategy: PID 315 died... 09:35:22.879399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=315): Terminated: ok {rc=0} 09:35:22.922857 --- ParallelTerminationStrategy: PID 318 died... 09:35:22.941621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=318): Terminated: ok {rc=0} 09:35:23.024271 bus /sierra_3: Setting Powered False 09:35:24.119186 bus /sierra_3: Setting Powered False 09:35:25.232747 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 09:35:26.319480 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:26.331454 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:35:26.373678 tst emergency_preemptive_call.py: using LAC 33067 09:35:26.496917 tst emergency_preemptive_call.py: using RAC 172 09:35:26.618272 tst emergency_preemptive_call.py: using CellId 33067 09:35:26.740170 tst emergency_preemptive_call.py: using BVCI 33068 09:35:26.853453 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:26.864677 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:26.875835 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:26.886819 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:26.897903 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:35:26.908999 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:27.025323 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:27.139682 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:27.252339 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:27.364369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:27.850647 run create_hlr_db(pid=321): Launched 09:35:27.978132 bus /sierra_2: Setting Powered False 09:35:29.040445 run create_hlr_db(pid=321): Terminated: ok {rc=0} 09:35:29.457938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=323): Launched 09:35:29.749918 run osmo-hlr_10.42.42.2(pid=324): Launched 09:35:29.862536 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:30.383244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=326): Launched 09:35:30.674724 run osmo-stp_10.42.42.5(pid=327): Launched 09:35:30.795840 tst emergency_preemptive_call.py: using MSISDN 8085 09:35:31.028816 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:31.630289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=349): Launched 09:35:31.991331 run osmo-msc_10.42.42.6(pid=355): Launched 09:35:32.434079 run osmo-stp_10.42.42.5(pid=327): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=327)] 09:35:32.715430 run osmo-stp_10.42.42.5(pid=327): stdout: | (launched: 2022-12-13_09:35:30.621206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:32.904228 run osmo-stp_10.42.42.5(pid=327): stderr: | 20221213093530791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093530791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093530791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093530792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093530792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093530792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093530792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:33.052921 run osmo-stp_10.42.42.5(pid=327): stdout: | (launched: 2022-12-13_09:35:30.621206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:33.201500 run osmo-stp_10.42.42.5(pid=327): stderr: | 20221213093530791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093530791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093530791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093530792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093530792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093530792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093530792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:33.363348 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=327): Process ended prematurely: osmo-stp_10.42.42.5(pid=327) [trial-2387↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=327)] [trial-2387↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 09:35:33.371839 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 09:35:33.398345 run osmo-hlr_10.42.42.2(pid=324): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=324)] 09:35:33.451517 run osmo-hlr_10.42.42.2(pid=324): stdout: | (launched: 2022-12-13_09:35:29.696339) 09:35:33.502269 run osmo-hlr_10.42.42.2(pid=324): stderr: | 20221213093529871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093529871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093529871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093529871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093529871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093529871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093529881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093529890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093529890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093529890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:33.575713 run osmo-msc_10.42.42.6(pid=355): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=355)] 09:35:33.625388 run osmo-msc_10.42.42.6(pid=355): stdout: | (launched: 2022-12-13_09:35:31.927448) 09:35:33.677103 run osmo-msc_10.42.42.6(pid=355): stderr: | 20221213093532327 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093532327 DLGLOBAL DEBUG validating counter group 0x7fbcce2b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093532327 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093532327 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093532327 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093532327 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093532329 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093532330 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093532330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093532330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:33.730579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=323): Terminating (SIGTERM) 09:35:33.772486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=326): Terminating (SIGTERM) 09:35:33.816733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=349): Terminating (SIGTERM) 09:35:33.860223 --- ParallelTerminationStrategy: PID 323 died... 09:35:33.881562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=323): Terminated: ok {rc=0} 09:35:33.930020 --- ParallelTerminationStrategy: PID 326 died... 09:35:33.950694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=326): Terminated: ok {rc=0} 09:35:33.997539 --- ParallelTerminationStrategy: PID 349 died... 09:35:34.019504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=349): Terminated: ok {rc=0} 09:35:34.106904 bus /sierra_9: Setting Powered False 09:35:35.204146 bus /sierra_9: Setting Powered False 09:35:36.319353 bus /sierra_8: Setting Powered False 09:35:37.417537 bus /sierra_8: Setting Powered False 09:35:38.532902 bus /sierra_3: Setting Powered False 09:35:39.629478 bus /sierra_3: Setting Powered False 09:35:40.747875 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-1900 --------------------------------------------------------------------- 09:35:42.023155 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:35:42.028765 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:35:42.053212 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 09:35:42.093133 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:35:42.180533 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:35:42.204697 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 09:35:42.243976 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:35:42.836823 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 09:35:42.888236 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:42.899342 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:35:42.938018 tst cs_paging_gprs_active.py: using LAC 33068 09:35:43.063777 tst cs_paging_gprs_active.py: using RAC 173 09:35:43.188633 tst cs_paging_gprs_active.py: using CellId 33068 09:35:43.312809 tst cs_paging_gprs_active.py: using BVCI 33069 09:35:43.428331 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.439571 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.450500 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.461458 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.472504 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.483607 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.494838 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.505878 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:43.517080 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:43.632453 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:43.751267 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:35:43.966557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:44.286754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=396): Launched 09:35:44.563612 run iperf3-srv_10.42.42.10(pid=397): Launched 09:35:44.683293 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:35:44.898038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:45.218163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=398): Launched 09:35:45.494404 run iperf3-srv_10.42.42.10(pid=399): Launched 09:35:45.613815 tst cs_paging_gprs_active.py:38: start network... 09:35:45.827807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:46.343352 run create_hlr_db(pid=400): Launched 09:35:46.505851 bus /sierra_2: Setting Powered False 09:35:47.565175 run create_hlr_db(pid=400): Terminated: ok {rc=0} 09:35:48.011077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=402): Launched 09:35:48.330066 run osmo-hlr_10.42.42.2(pid=403): Launched 09:35:48.451474 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:49.001776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=405): Launched 09:35:49.319748 run osmo-stp_10.42.42.5(pid=406): Launched 09:35:49.441722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:49.992508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=408): Launched 09:35:50.114574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:50.385446 run patchelf(pid=409): Launched 09:35:50.562718 run osmo-stp_10.42.42.5(pid=406): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=406)] 09:35:50.697563 run osmo-stp_10.42.42.5(pid=406): stdout: | (launched: 2022-12-13_09:35:49.262144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:50.834179 run osmo-stp_10.42.42.5(pid=406): stderr: | 20221213093549455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093549455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093549456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093549456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093549456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093549457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093549457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:50.970905 run osmo-stp_10.42.42.5(pid=406): stdout: | (launched: 2022-12-13_09:35:49.262144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:51.101813 run osmo-stp_10.42.42.5(pid=406): stderr: | 20221213093549455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093549455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093549456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093549456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093549456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093549457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093549457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:51.256730 run patchelf(pid=409): Terminating (SIGINT) 09:35:51.435309 run patchelf(pid=409): Terminated: ok {rc=0} 09:35:51.563806 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=406): Process ended prematurely: osmo-stp_10.42.42.5(pid=406) [trial-2387↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=406)] [trial-2387↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 09:35:51.573780 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:35:51.601743 run osmo-hlr_10.42.42.2(pid=403): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=403)] 09:35:51.651118 run osmo-hlr_10.42.42.2(pid=403): stdout: | (launched: 2022-12-13_09:35:48.272038) 09:35:51.702082 run osmo-hlr_10.42.42.2(pid=403): stderr: | 20221213093548471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093548471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093548471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093548471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093548472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093548472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093548485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093548495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093548495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093548495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:51.753954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=396): Terminating (SIGTERM) 09:35:51.799049 run iperf3-srv_10.42.42.10(pid=397): Terminating (SIGTERM) 09:35:51.840688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=398): Terminating (SIGTERM) 09:35:51.886062 run iperf3-srv_10.42.42.10(pid=399): Terminating (SIGTERM) 09:35:51.927681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=402): Terminating (SIGTERM) 09:35:51.969967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=405): Terminating (SIGTERM) 09:35:52.012266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=408): Terminating (SIGTERM) 09:35:52.054869 --- ParallelTerminationStrategy: PID 396 died... 09:35:52.074854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=396): Terminated: ok {rc=0} 09:35:52.120875 --- ParallelTerminationStrategy: PID 397 died... 09:35:52.141091 run iperf3-srv_10.42.42.10(pid=397): Terminated {rc=256} 09:35:52.186985 --- ParallelTerminationStrategy: PID 398 died... 09:35:52.206534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=398): Terminated: ok {rc=0} 09:35:52.252617 --- ParallelTerminationStrategy: PID 399 died... 09:35:52.272038 run iperf3-srv_10.42.42.10(pid=399): Terminated {rc=256} 09:35:52.318164 --- ParallelTerminationStrategy: PID 402 died... 09:35:52.337783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=402): Terminated: ok {rc=0} 09:35:52.383540 --- ParallelTerminationStrategy: PID 405 died... 09:35:52.403054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=405): Terminated: ok {rc=0} 09:35:52.448816 --- ParallelTerminationStrategy: PID 408 died... 09:35:52.468917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=408): Terminated: ok {rc=0} 09:35:52.555248 bus /gobi_0: Setting Powered False 09:35:53.653483 bus /gobi_0: Setting Powered False 09:35:54.767522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 09:35:55.915435 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:55.927152 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:35:55.967181 tst iperf3.py: using LAC 33069 09:35:56.094551 tst iperf3.py: using RAC 174 09:35:56.221314 tst iperf3.py: using CellId 33069 09:35:56.352742 tst iperf3.py: using BVCI 33070 09:35:56.462863 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.473815 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.484487 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.495025 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.506120 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.516875 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.528203 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.541962 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:35:56.553151 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:35:56.669567 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:35:56.869752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:57.168325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=411): Launched 09:35:57.427071 run iperf3-srv_10.42.42.10(pid=412): Launched 09:35:57.538759 tst iperf3.py:8: start network... 09:35:57.738622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:58.199834 run create_hlr_db(pid=413): Launched 09:35:58.314014 bus /gobi_6: Setting Powered False 09:35:59.375044 run create_hlr_db(pid=413): Terminated: ok {rc=0} 09:35:59.810153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=415): Launched 09:36:00.128026 run osmo-hlr_10.42.42.2(pid=416): Launched 09:36:00.250281 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:00.794740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=418): Launched 09:36:01.131426 run osmo-stp_10.42.42.5(pid=419): Launched 09:36:01.283909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:02.153734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=421): Launched 09:36:02.273502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:02.531305 run patchelf(pid=422): Launched 09:36:02.698067 run osmo-stp_10.42.42.5(pid=419): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=419)] 09:36:02.824570 run osmo-stp_10.42.42.5(pid=419): stdout: | (launched: 2022-12-13_09:36:01.072060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:02.952754 run osmo-stp_10.42.42.5(pid=419): stderr: | 20221213093601438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093601438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093601439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093601441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093601442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093601442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093601442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:03.080888 run osmo-stp_10.42.42.5(pid=419): stdout: | (launched: 2022-12-13_09:36:01.072060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:03.203613 run osmo-stp_10.42.42.5(pid=419): stderr: | 20221213093601438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093601438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093601439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093601441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093601442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093601442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093601442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:03.348771 run patchelf(pid=422): Terminating (SIGINT) 09:36:03.516345 run patchelf(pid=422): Terminated: ok {rc=0} 09:36:03.637328 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=419): Process ended prematurely: osmo-stp_10.42.42.5(pid=419) [trial-2387↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=419)] [trial-2387↪gprs:nanobts+band-1900↪iperf3.py:8] 09:36:03.646666 tst iperf3.py:8: Test FAILED (7.8 sec) 09:36:03.673456 run osmo-hlr_10.42.42.2(pid=416): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=416)] 09:36:03.721324 run osmo-hlr_10.42.42.2(pid=416): stdout: | (launched: 2022-12-13_09:36:00.070089) 09:36:03.770612 run osmo-hlr_10.42.42.2(pid=416): stderr: | 20221213093600269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093600269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093600269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093600269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093600269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093600269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093600281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093600289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093600289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093600289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:03.820098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=411): Terminating (SIGTERM) 09:36:03.859984 run iperf3-srv_10.42.42.10(pid=412): Terminating (SIGTERM) 09:36:03.899679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=415): Terminating (SIGTERM) 09:36:03.939357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=418): Terminating (SIGTERM) 09:36:03.978898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=421): Terminating (SIGTERM) 09:36:04.018675 --- ParallelTerminationStrategy: PID 411 died... 09:36:04.038218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=411): Terminated: ok {rc=0} 09:36:04.082314 --- ParallelTerminationStrategy: PID 412 died... 09:36:04.101407 run iperf3-srv_10.42.42.10(pid=412): Terminated {rc=256} 09:36:04.145450 --- ParallelTerminationStrategy: PID 415 died... 09:36:04.164337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=415): Terminated: ok {rc=0} 09:36:04.208013 --- ParallelTerminationStrategy: PID 418 died... 09:36:04.227081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=418): Terminated: ok {rc=0} 09:36:04.271208 --- ParallelTerminationStrategy: PID 421 died... 09:36:04.290262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=421): Terminated: ok {rc=0} 09:36:04.375749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 09:36:05.521643 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:05.533711 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:36:05.571697 tst iperf3m4.py: using LAC 33070 09:36:05.687803 tst iperf3m4.py: using RAC 175 09:36:05.805327 tst iperf3m4.py: using CellId 33070 09:36:05.931253 tst iperf3m4.py: using BVCI 33071 09:36:06.047089 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.058526 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.069522 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.080542 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.091542 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.102494 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.113538 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.124303 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:06.135395 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:36:06.252656 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:36:06.373830 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:36:06.491015 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:36:06.609993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:36:06.826009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:07.147037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=423): Launched 09:36:07.423484 run iperf3-srv_10.42.42.10(pid=424): Launched 09:36:07.542850 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:36:07.756673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:08.076733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=425): Launched 09:36:08.353428 run iperf3-srv_10.42.42.10(pid=426): Launched 09:36:08.472772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:36:08.687346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:09.006301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=427): Launched 09:36:09.282226 run iperf3-srv_10.42.42.10(pid=428): Launched 09:36:09.401499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:36:09.615344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:09.934915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=429): Launched 09:36:10.212131 run iperf3-srv_10.42.42.10(pid=430): Launched 09:36:10.332169 tst iperf3m4.py:8: start network... 09:36:10.546932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:11.043641 run create_hlr_db(pid=431): Launched 09:36:11.172709 bus /gobi_6: Setting Powered False 09:36:12.236252 run create_hlr_db(pid=431): Terminated: ok {rc=0} 09:36:12.661250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=433): Launched 09:36:12.960497 run osmo-hlr_10.42.42.2(pid=434): Launched 09:36:13.074762 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:13.599852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=436): Launched 09:36:13.896688 run osmo-stp_10.42.42.5(pid=437): Launched 09:36:14.011276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:14.525666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=439): Launched 09:36:14.639862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:14.891527 run patchelf(pid=440): Launched 09:36:15.059393 run osmo-stp_10.42.42.5(pid=437): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=437)] 09:36:15.185440 run osmo-stp_10.42.42.5(pid=437): stdout: | (launched: 2022-12-13_09:36:13.842127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:15.313402 run osmo-stp_10.42.42.5(pid=437): stderr: | 20221213093614012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093614012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093614012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093614013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093614015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093614015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093614015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:15.441078 run osmo-stp_10.42.42.5(pid=437): stdout: | (launched: 2022-12-13_09:36:13.842127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:15.563520 run osmo-stp_10.42.42.5(pid=437): stderr: | 20221213093614012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093614012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093614012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093614013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093614015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093614015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093614015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:15.708548 run patchelf(pid=440): Terminating (SIGINT) 09:36:15.878626 run patchelf(pid=440): Terminated: ok {rc=0} 09:36:16.009667 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=437): Process ended prematurely: osmo-stp_10.42.42.5(pid=437) [trial-2387↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=437)] [trial-2387↪gprs:nanobts+band-1900↪iperf3m4.py:8] 09:36:16.020082 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:36:16.048322 run osmo-hlr_10.42.42.2(pid=434): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=434)] 09:36:16.098296 run osmo-hlr_10.42.42.2(pid=434): stdout: | (launched: 2022-12-13_09:36:12.905668) 09:36:16.149203 run osmo-hlr_10.42.42.2(pid=434): stderr: | 20221213093613080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093613080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093613080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093613080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093613080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093613080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093613092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093613101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093613101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093613101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:16.200715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=423): Terminating (SIGTERM) 09:36:16.243020 run iperf3-srv_10.42.42.10(pid=424): Terminating (SIGTERM) 09:36:16.287524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=425): Terminating (SIGTERM) 09:36:16.330361 run iperf3-srv_10.42.42.10(pid=426): Terminating (SIGTERM) 09:36:16.375121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=427): Terminating (SIGTERM) 09:36:16.417887 run iperf3-srv_10.42.42.10(pid=428): Terminating (SIGTERM) 09:36:16.462353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=429): Terminating (SIGTERM) 09:36:16.505240 run iperf3-srv_10.42.42.10(pid=430): Terminating (SIGTERM) 09:36:16.549969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=433): Terminating (SIGTERM) 09:36:16.592529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=436): Terminating (SIGTERM) 09:36:16.634227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=439): Terminating (SIGTERM) 09:36:16.676119 --- ParallelTerminationStrategy: PID 423 died... 09:36:16.697171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=423): Terminated: ok {rc=0} 09:36:16.743488 --- ParallelTerminationStrategy: PID 424 died... 09:36:16.764043 run iperf3-srv_10.42.42.10(pid=424): Terminated {rc=256} 09:36:16.810627 --- ParallelTerminationStrategy: PID 425 died... 09:36:16.831333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=425): Terminated: ok {rc=0} 09:36:16.877385 --- ParallelTerminationStrategy: PID 426 died... 09:36:16.898051 run iperf3-srv_10.42.42.10(pid=426): Terminated {rc=256} 09:36:16.944164 --- ParallelTerminationStrategy: PID 427 died... 09:36:16.965024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=427): Terminated: ok {rc=0} 09:36:17.010910 --- ParallelTerminationStrategy: PID 428 died... 09:36:17.031584 run iperf3-srv_10.42.42.10(pid=428): Terminated {rc=256} 09:36:17.077596 --- ParallelTerminationStrategy: PID 429 died... 09:36:17.098444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=429): Terminated: ok {rc=0} 09:36:17.144472 --- ParallelTerminationStrategy: PID 430 died... 09:36:17.165193 run iperf3-srv_10.42.42.10(pid=430): Terminated {rc=256} 09:36:17.211002 --- ParallelTerminationStrategy: PID 433 died... 09:36:17.232123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=433): Terminated: ok {rc=0} 09:36:17.275948 --- ParallelTerminationStrategy: PID 436 died... 09:36:17.295015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=436): Terminated: ok {rc=0} 09:36:17.339012 --- ParallelTerminationStrategy: PID 439 died... 09:36:17.358148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=439): Terminated: ok {rc=0} 09:36:17.443827 bus /gobi_4: Setting Powered False 09:36:18.541277 bus /gobi_4: Setting Powered False 09:36:19.656439 bus /gobi_1: Setting Powered False 09:36:20.754191 bus /gobi_1: Setting Powered False 09:36:21.867400 bus /gobi_0: Setting Powered False 09:36:22.970263 bus /gobi_0: Setting Powered False 09:36:24.085355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 09:36:25.187428 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.199172 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:36:25.242431 tst ping.py: using LAC 33071 09:36:25.364758 tst ping.py: using RAC 176 09:36:25.486908 tst ping.py: using CellId 33071 09:36:25.608224 tst ping.py: using BVCI 33072 09:36:25.721412 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.732623 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.743735 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.754731 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.765695 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.776559 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.787677 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:25.798877 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:36:25.915403 tst ping.py:19: start network... 09:36:26.125735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:26.610041 run create_hlr_db(pid=441): Launched 09:36:26.737034 bus /gobi_6: Setting Powered False 09:36:27.799099 run create_hlr_db(pid=441): Terminated: ok {rc=0} 09:36:28.216174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=443): Launched 09:36:28.509058 run osmo-hlr_10.42.42.2(pid=444): Launched 09:36:28.621622 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:29.127321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=446): Launched 09:36:29.418981 run osmo-stp_10.42.42.5(pid=447): Launched 09:36:29.530347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:30.034622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=449): Launched 09:36:30.145880 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:30.392483 run patchelf(pid=450): Launched 09:36:30.555741 run osmo-stp_10.42.42.5(pid=447): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=447)] 09:36:30.679694 run osmo-stp_10.42.42.5(pid=447): stdout: | (launched: 2022-12-13_09:36:29.365458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:30.804861 run osmo-stp_10.42.42.5(pid=447): stderr: | 20221213093629535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093629535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093629536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093629536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093629536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093629537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093629537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:30.954404 run osmo-stp_10.42.42.5(pid=447): stdout: | (launched: 2022-12-13_09:36:29.365458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:31.084142 run osmo-stp_10.42.42.5(pid=447): stderr: | 20221213093629535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093629535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093629536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093629536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093629536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093629537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093629537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:31.238993 run patchelf(pid=450): Terminating (SIGINT) 09:36:31.411980 run patchelf(pid=450): Terminated: ok {rc=0} 09:36:31.535356 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=447): Process ended prematurely: osmo-stp_10.42.42.5(pid=447) [trial-2387↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=447)] [trial-2387↪gprs:nanobts+band-1900↪ping.py:22] 09:36:31.545404 tst ping.py:22: Test FAILED (6.3 sec) 09:36:31.573281 run osmo-hlr_10.42.42.2(pid=444): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=444)] 09:36:31.624705 run osmo-hlr_10.42.42.2(pid=444): stdout: | (launched: 2022-12-13_09:36:28.455295) 09:36:31.676198 run osmo-hlr_10.42.42.2(pid=444): stderr: | 20221213093628631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093628631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093628631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093628631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093628631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093628631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093628689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093628698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093628698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093628698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:31.729580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=443): Terminating (SIGTERM) 09:36:31.770280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=446): Terminating (SIGTERM) 09:36:31.811633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=449): Terminating (SIGTERM) 09:36:31.853699 --- ParallelTerminationStrategy: PID 443 died... 09:36:31.874652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=443): Terminated: ok {rc=0} 09:36:31.921112 --- ParallelTerminationStrategy: PID 446 died... 09:36:31.941848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=446): Terminated: ok {rc=0} 09:36:31.987873 --- ParallelTerminationStrategy: PID 449 died... 09:36:32.008738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=449): Terminated: ok {rc=0} 09:36:32.100152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 09:36:33.190330 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.201711 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:36:33.241385 tst ping_idle_ping.py: using LAC 33072 09:36:33.356942 tst ping_idle_ping.py: using RAC 177 09:36:33.471967 tst ping_idle_ping.py: using CellId 33072 09:36:33.587090 tst ping_idle_ping.py: using BVCI 33073 09:36:33.695129 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.706011 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.716466 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.726912 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.737580 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.748900 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.760239 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:36:33.771069 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:36:33.889736 tst ping_idle_ping.py:24: start network... 09:36:34.100942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:34.588398 run create_hlr_db(pid=451): Launched 09:36:34.716421 bus /gobi_6: Setting Powered False 09:36:35.779423 run create_hlr_db(pid=451): Terminated: ok {rc=0} 09:36:36.200263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=453): Launched 09:36:36.494284 run osmo-hlr_10.42.42.2(pid=454): Launched 09:36:36.606599 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:37.112798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=456): Launched 09:36:37.406286 run osmo-stp_10.42.42.5(pid=457): Launched 09:36:37.519300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:38.025913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=459): Launched 09:36:38.138857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:38.386265 run patchelf(pid=460): Launched 09:36:38.550009 run osmo-stp_10.42.42.5(pid=457): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=457)] 09:36:38.674224 run osmo-stp_10.42.42.5(pid=457): stdout: | (launched: 2022-12-13_09:36:37.352463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:38.800123 run osmo-stp_10.42.42.5(pid=457): stderr: | 20221213093637523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093637523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093637523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093637524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093637524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093637524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093637524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:38.925664 run osmo-stp_10.42.42.5(pid=457): stdout: | (launched: 2022-12-13_09:36:37.352463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:39.046340 run osmo-stp_10.42.42.5(pid=457): stderr: | 20221213093637523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093637523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093637523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093637524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093637524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093637524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093637524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:39.189131 run patchelf(pid=460): Terminating (SIGINT) 09:36:39.354166 run patchelf(pid=460): Terminated: ok {rc=0} 09:36:39.473098 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=457): Process ended prematurely: osmo-stp_10.42.42.5(pid=457) [trial-2387↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=457)] [trial-2387↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 09:36:39.481834 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:36:39.508311 run osmo-hlr_10.42.42.2(pid=454): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=454)] 09:36:39.555794 run osmo-hlr_10.42.42.2(pid=454): stdout: | (launched: 2022-12-13_09:36:36.439669) 09:36:39.604720 run osmo-hlr_10.42.42.2(pid=454): stderr: | 20221213093636616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093636616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093636616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093636616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093636616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093636617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093636630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093636638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093636638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093636638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:39.653898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=453): Terminating (SIGTERM) 09:36:39.693379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=456): Terminating (SIGTERM) 09:36:39.733045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=459): Terminating (SIGTERM) 09:36:39.772594 --- ParallelTerminationStrategy: PID 453 died... 09:36:39.791854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=453): Terminated: ok {rc=0} 09:36:39.835805 --- ParallelTerminationStrategy: PID 456 died... 09:36:39.854710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=456): Terminated: ok {rc=0} 09:36:39.898223 --- ParallelTerminationStrategy: PID 459 died... 09:36:39.917055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=459): Terminated: ok {rc=0} 09:36:40.000220 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 09:36:41.303427 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:36:41.310658 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:36:41.335317 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:36:41.375573 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:36:41.468358 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:36:41.493024 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:36:41.532708 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:36:42.118785 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:36:42.169172 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.180170 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:36:42.223471 tst cs_paging_gprs_active.py: using LAC 33073 09:36:42.349818 tst cs_paging_gprs_active.py: using RAC 178 09:36:42.476239 tst cs_paging_gprs_active.py: using CellId 33073 09:36:42.600133 tst cs_paging_gprs_active.py: using BVCI 33074 09:36:42.717234 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.728609 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.739787 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.750923 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.761982 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.772935 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.784443 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.795540 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:42.806805 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:42.924252 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:43.041362 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:36:43.241544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:43.540196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=464): Launched 09:36:43.799809 run iperf3-srv_10.42.42.10(pid=465): Launched 09:36:43.912080 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:36:44.111915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:44.410385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=466): Launched 09:36:44.669464 run iperf3-srv_10.42.42.10(pid=467): Launched 09:36:44.780746 tst cs_paging_gprs_active.py:38: start network... 09:36:44.979869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:45.441434 run create_hlr_db(pid=468): Launched 09:36:45.555791 bus /gobi_6: Setting Powered False 09:36:46.614760 run create_hlr_db(pid=468): Terminated: ok {rc=0} 09:36:47.054930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=470): Launched 09:36:47.392856 run osmo-hlr_10.42.42.2(pid=471): Launched 09:36:47.509279 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:48.020437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=473): Launched 09:36:48.318162 run osmo-stp_10.42.42.5(pid=474): Launched 09:36:48.434136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:48.949349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=476): Launched 09:36:49.063274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:49.315056 run patchelf(pid=477): Launched 09:36:49.480240 run osmo-stp_10.42.42.5(pid=474): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=474)] 09:36:49.606247 run osmo-stp_10.42.42.5(pid=474): stdout: | (launched: 2022-12-13_09:36:48.263876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:49.734037 run osmo-stp_10.42.42.5(pid=474): stderr: | 20221213093648431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093648431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093648431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093648431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093648434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093648434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093648434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:49.861816 run osmo-stp_10.42.42.5(pid=474): stdout: | (launched: 2022-12-13_09:36:48.263876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:49.984338 run osmo-stp_10.42.42.5(pid=474): stderr: | 20221213093648431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093648431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093648431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093648431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093648434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093648434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093648434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:50.129741 run patchelf(pid=477): Terminating (SIGINT) 09:36:50.296665 run patchelf(pid=477): Terminated: ok {rc=0} 09:36:50.417005 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=474): Process ended prematurely: osmo-stp_10.42.42.5(pid=474) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=474)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:36:50.426529 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 09:36:50.453283 run osmo-hlr_10.42.42.2(pid=471): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=471)] 09:36:50.500709 run osmo-hlr_10.42.42.2(pid=471): stdout: | (launched: 2022-12-13_09:36:47.338720) 09:36:50.549807 run osmo-hlr_10.42.42.2(pid=471): stderr: | 20221213093647516 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093647516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093647516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093647516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093647516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093647516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093647530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093647538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093647539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093647539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:50.599089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=464): Terminating (SIGTERM) 09:36:50.639128 run iperf3-srv_10.42.42.10(pid=465): Terminating (SIGTERM) 09:36:50.678669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=466): Terminating (SIGTERM) 09:36:50.718193 run iperf3-srv_10.42.42.10(pid=467): Terminating (SIGTERM) 09:36:50.757339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=470): Terminating (SIGTERM) 09:36:50.797345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=473): Terminating (SIGTERM) 09:36:50.836667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=476): Terminating (SIGTERM) 09:36:50.876306 --- ParallelTerminationStrategy: PID 464 died... 09:36:50.895505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=464): Terminated: ok {rc=0} 09:36:50.939289 --- ParallelTerminationStrategy: PID 465 died... 09:36:50.957949 run iperf3-srv_10.42.42.10(pid=465): Terminated {rc=256} 09:36:51.001305 --- ParallelTerminationStrategy: PID 466 died... 09:36:51.020070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=466): Terminated: ok {rc=0} 09:36:51.063538 --- ParallelTerminationStrategy: PID 467 died... 09:36:51.082087 run iperf3-srv_10.42.42.10(pid=467): Terminated {rc=256} 09:36:51.125459 --- ParallelTerminationStrategy: PID 470 died... 09:36:51.144045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=470): Terminated: ok {rc=0} 09:36:51.187510 --- ParallelTerminationStrategy: PID 473 died... 09:36:51.206132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=473): Terminated: ok {rc=0} 09:36:51.249512 --- ParallelTerminationStrategy: PID 476 died... 09:36:51.268150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=476): Terminated: ok {rc=0} 09:36:51.351206 bus /gobi_0: Setting Powered False 09:36:52.445224 bus /gobi_0: Setting Powered False 09:36:53.559242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:36:54.703680 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:54.715139 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:36:54.758593 tst iperf3.py: using LAC 33074 09:36:54.884865 tst iperf3.py: using RAC 179 09:36:55.009295 tst iperf3.py: using CellId 33074 09:36:55.134344 tst iperf3.py: using BVCI 33075 09:36:55.251432 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.263085 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.274429 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.285601 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.296911 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.308086 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.319459 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.330574 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:55.341955 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:55.458548 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:36:55.659825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:55.959345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=478): Launched 09:36:56.219319 run iperf3-srv_10.42.42.10(pid=479): Launched 09:36:56.331374 tst iperf3.py:8: start network... 09:36:56.531317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:56.994060 run create_hlr_db(pid=480): Launched 09:36:57.108732 bus /gobi_6: Setting Powered False 09:36:58.168471 run create_hlr_db(pid=480): Terminated: ok {rc=0} 09:36:58.604853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=482): Launched 09:36:58.924397 run osmo-hlr_10.42.42.2(pid=483): Launched 09:36:59.046851 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:59.602021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=485): Launched 09:36:59.919463 run osmo-stp_10.42.42.5(pid=486): Launched 09:37:00.041402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:00.593676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=488): Launched 09:37:00.715517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:01.009712 run patchelf(pid=489): Launched 09:37:01.185951 run osmo-stp_10.42.42.5(pid=486): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=486)] 09:37:01.316279 run osmo-stp_10.42.42.5(pid=486): stdout: | (launched: 2022-12-13_09:36:59.861550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:01.450664 run osmo-stp_10.42.42.5(pid=486): stderr: | 20221213093700053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093700053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093700053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093700053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093700054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093700054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093700054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:01.585639 run osmo-stp_10.42.42.5(pid=486): stdout: | (launched: 2022-12-13_09:36:59.861550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:01.713948 run osmo-stp_10.42.42.5(pid=486): stderr: | 20221213093700053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093700053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093700053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093700053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093700054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093700054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093700054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:01.864836 run patchelf(pid=489): Terminating (SIGINT) 09:37:02.040065 run patchelf(pid=489): Terminated: ok {rc=0} 09:37:02.165819 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=486): Process ended prematurely: osmo-stp_10.42.42.5(pid=486) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=486)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 09:37:02.176265 tst iperf3.py:8: Test FAILED (7.5 sec) 09:37:02.204843 run osmo-hlr_10.42.42.2(pid=483): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=483)] 09:37:02.255717 run osmo-hlr_10.42.42.2(pid=483): stdout: | (launched: 2022-12-13_09:36:58.866747) 09:37:02.305935 run osmo-hlr_10.42.42.2(pid=483): stderr: | 20221213093659063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093659063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093659064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093659064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093659064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093659064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093659076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093659084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093659084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093659084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:02.356547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=478): Terminating (SIGTERM) 09:37:02.397052 run iperf3-srv_10.42.42.10(pid=479): Terminating (SIGTERM) 09:37:02.437652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=482): Terminating (SIGTERM) 09:37:02.478134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=485): Terminating (SIGTERM) 09:37:02.518505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=488): Terminating (SIGTERM) 09:37:02.559305 --- ParallelTerminationStrategy: PID 478 died... 09:37:02.579209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=478): Terminated: ok {rc=0} 09:37:02.624027 --- ParallelTerminationStrategy: PID 479 died... 09:37:02.643498 run iperf3-srv_10.42.42.10(pid=479): Terminated {rc=256} 09:37:02.688268 --- ParallelTerminationStrategy: PID 482 died... 09:37:02.708235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=482): Terminated: ok {rc=0} 09:37:02.753038 --- ParallelTerminationStrategy: PID 485 died... 09:37:02.772644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=485): Terminated: ok {rc=0} 09:37:02.816597 --- ParallelTerminationStrategy: PID 488 died... 09:37:02.835494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=488): Terminated: ok {rc=0} 09:37:02.921803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:37:04.066604 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.081355 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:37:04.119318 tst iperf3m4.py: using LAC 33075 09:37:04.236763 tst iperf3m4.py: using RAC 180 09:37:04.353333 tst iperf3m4.py: using CellId 33075 09:37:04.470698 tst iperf3m4.py: using BVCI 33076 09:37:04.580404 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.591390 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.602100 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.612781 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.623735 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.635175 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.646493 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.657699 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:04.668889 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:37:04.784757 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:37:04.907438 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:37:05.028071 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:37:05.145368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:37:05.347406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:05.648116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=490): Launched 09:37:05.910173 run iperf3-srv_10.42.42.10(pid=491): Launched 09:37:06.023172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:37:06.224670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:06.526779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=492): Launched 09:37:06.787605 run iperf3-srv_10.42.42.10(pid=493): Launched 09:37:06.900224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:37:07.101215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:07.401713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=494): Launched 09:37:07.661810 run iperf3-srv_10.42.42.10(pid=495): Launched 09:37:07.774439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:37:07.974839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:08.275332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=496): Launched 09:37:08.536692 run iperf3-srv_10.42.42.10(pid=497): Launched 09:37:08.649478 tst iperf3m4.py:8: start network... 09:37:08.850832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:09.314638 run create_hlr_db(pid=498): Launched 09:37:09.428511 bus /gobi_6: Setting Powered False 09:37:10.488705 run create_hlr_db(pid=498): Terminated: ok {rc=0} 09:37:10.907346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Launched 09:37:11.206209 run osmo-hlr_10.42.42.2(pid=501): Launched 09:37:11.319897 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:11.846977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Launched 09:37:12.146422 run osmo-stp_10.42.42.5(pid=504): Launched 09:37:12.261148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:12.789592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Launched 09:37:12.904094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:13.157180 run patchelf(pid=507): Launched 09:37:13.323869 run osmo-stp_10.42.42.5(pid=504): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] 09:37:13.451054 run osmo-stp_10.42.42.5(pid=504): stdout: | (launched: 2022-12-13_09:37:12.091169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:13.579776 run osmo-stp_10.42.42.5(pid=504): stderr: | 20221213093712262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093712262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093712262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093712263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093712263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093712263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093712263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:13.708560 run osmo-stp_10.42.42.5(pid=504): stdout: | (launched: 2022-12-13_09:37:12.091169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:13.831618 run osmo-stp_10.42.42.5(pid=504): stderr: | 20221213093712262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093712262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093712262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093712263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093712263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093712263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093712263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:13.977540 run patchelf(pid=507): Terminating (SIGINT) 09:37:14.146381 run patchelf(pid=507): Terminated: ok {rc=0} 09:37:14.268388 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=504): Process ended prematurely: osmo-stp_10.42.42.5(pid=504) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 09:37:14.278202 tst iperf3m4.py:8: Test FAILED (10.2 sec) 09:37:14.305773 run osmo-hlr_10.42.42.2(pid=501): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=501)] 09:37:14.354760 run osmo-hlr_10.42.42.2(pid=501): stdout: | (launched: 2022-12-13_09:37:11.151380) 09:37:14.405336 run osmo-hlr_10.42.42.2(pid=501): stderr: | 20221213093711328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093711328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093711328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093711328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093711328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093711328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093711342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093711350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093711351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093711351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:14.455901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=490): Terminating (SIGTERM) 09:37:14.496493 run iperf3-srv_10.42.42.10(pid=491): Terminating (SIGTERM) 09:37:14.537261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=492): Terminating (SIGTERM) 09:37:14.578136 run iperf3-srv_10.42.42.10(pid=493): Terminating (SIGTERM) 09:37:14.618590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=494): Terminating (SIGTERM) 09:37:14.658571 run iperf3-srv_10.42.42.10(pid=495): Terminating (SIGTERM) 09:37:14.698571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=496): Terminating (SIGTERM) 09:37:14.738641 run iperf3-srv_10.42.42.10(pid=497): Terminating (SIGTERM) 09:37:14.778552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Terminating (SIGTERM) 09:37:14.818853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Terminating (SIGTERM) 09:37:14.858835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Terminating (SIGTERM) 09:37:14.898954 --- ParallelTerminationStrategy: PID 490 died... 09:37:14.918618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=490): Terminated: ok {rc=0} 09:37:14.963063 --- ParallelTerminationStrategy: PID 491 died... 09:37:14.982207 run iperf3-srv_10.42.42.10(pid=491): Terminated {rc=256} 09:37:15.026234 --- ParallelTerminationStrategy: PID 492 died... 09:37:15.045449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=492): Terminated: ok {rc=0} 09:37:15.089378 --- ParallelTerminationStrategy: PID 493 died... 09:37:15.108346 run iperf3-srv_10.42.42.10(pid=493): Terminated {rc=256} 09:37:15.152564 --- ParallelTerminationStrategy: PID 494 died... 09:37:15.171203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=494): Terminated: ok {rc=0} 09:37:15.214836 --- ParallelTerminationStrategy: PID 495 died... 09:37:15.233537 run iperf3-srv_10.42.42.10(pid=495): Terminated {rc=256} 09:37:15.276636 --- ParallelTerminationStrategy: PID 496 died... 09:37:15.295532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=496): Terminated: ok {rc=0} 09:37:15.339016 --- ParallelTerminationStrategy: PID 497 died... 09:37:15.357757 run iperf3-srv_10.42.42.10(pid=497): Terminated {rc=256} 09:37:15.401170 --- ParallelTerminationStrategy: PID 500 died... 09:37:15.419763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Terminated: ok {rc=0} 09:37:15.463313 --- ParallelTerminationStrategy: PID 503 died... 09:37:15.482053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Terminated: ok {rc=0} 09:37:15.525656 --- ParallelTerminationStrategy: PID 506 died... 09:37:15.544753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Terminated: ok {rc=0} 09:37:15.627477 bus /gobi_4: Setting Powered False 09:37:16.723194 bus /gobi_4: Setting Powered False 09:37:17.840758 bus /gobi_1: Setting Powered False 09:37:18.938149 bus /gobi_1: Setting Powered False 09:37:20.052694 bus /gobi_0: Setting Powered False 09:37:21.150875 bus /gobi_0: Setting Powered False 09:37:22.266164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 09:37:23.367889 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.380181 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:37:23.422015 tst ping.py: using LAC 33076 09:37:23.546740 tst ping.py: using RAC 181 09:37:23.671041 tst ping.py: using CellId 33076 09:37:23.793326 tst ping.py: using BVCI 33077 09:37:23.906923 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.918352 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.929789 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.941665 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.952937 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.964250 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.975580 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:23.986824 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:37:24.101943 tst ping.py:19: start network... 09:37:24.297175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:24.748818 run create_hlr_db(pid=508): Launched 09:37:24.860651 bus /gobi_6: Setting Powered False 09:37:25.919602 run create_hlr_db(pid=508): Terminated: ok {rc=0} 09:37:26.347359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=510): Launched 09:37:26.659048 run osmo-hlr_10.42.42.2(pid=511): Launched 09:37:26.778272 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:27.319993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=513): Launched 09:37:27.633643 run osmo-stp_10.42.42.5(pid=514): Launched 09:37:27.752174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:28.291874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=516): Launched 09:37:28.411711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:28.676134 run patchelf(pid=517): Launched 09:37:28.850525 run osmo-stp_10.42.42.5(pid=514): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=514)] 09:37:28.983794 run osmo-stp_10.42.42.5(pid=514): stdout: | (launched: 2022-12-13_09:37:27.575434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:29.118386 run osmo-stp_10.42.42.5(pid=514): stderr: | 20221213093727767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093727767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093727767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093727768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093727770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093727770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093727770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:29.253314 run osmo-stp_10.42.42.5(pid=514): stdout: | (launched: 2022-12-13_09:37:27.575434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:29.381982 run osmo-stp_10.42.42.5(pid=514): stderr: | 20221213093727767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093727767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093727767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093727768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093727770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093727770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093727770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:29.534129 run patchelf(pid=517): Terminating (SIGINT) 09:37:29.709286 run patchelf(pid=517): Terminated: ok {rc=0} 09:37:29.835959 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=514): Process ended prematurely: osmo-stp_10.42.42.5(pid=514) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=514)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 09:37:29.845444 tst ping.py:22: Test FAILED (6.5 sec) 09:37:29.873185 run osmo-hlr_10.42.42.2(pid=511): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=511)] 09:37:29.922615 run osmo-hlr_10.42.42.2(pid=511): stdout: | (launched: 2022-12-13_09:37:26.602263) 09:37:29.974033 run osmo-hlr_10.42.42.2(pid=511): stderr: | 20221213093726798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093726798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093726798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093726798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093726798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093726798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093726810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093726818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093726818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093726819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:30.025960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=510): Terminating (SIGTERM) 09:37:30.067734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=513): Terminating (SIGTERM) 09:37:30.109761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=516): Terminating (SIGTERM) 09:37:30.151798 --- ParallelTerminationStrategy: PID 510 died... 09:37:30.172085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=510): Terminated: ok {rc=0} 09:37:30.218199 --- ParallelTerminationStrategy: PID 513 died... 09:37:30.238069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=513): Terminated: ok {rc=0} 09:37:30.284148 --- ParallelTerminationStrategy: PID 516 died... 09:37:30.303935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=516): Terminated: ok {rc=0} 09:37:30.390734 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:37:31.475940 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:31.488869 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:37:31.533317 tst ping_idle_ping.py: using LAC 33077 09:37:31.687343 tst ping_idle_ping.py: using RAC 182 09:37:31.847452 tst ping_idle_ping.py: using CellId 33077 09:37:31.971970 tst ping_idle_ping.py: using BVCI 33078 09:37:32.127875 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:32.142845 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:32.159293 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:32.175025 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:32.190169 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:32.202879 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:32.214856 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:37:32.226964 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:37:32.349026 tst ping_idle_ping.py:24: start network... 09:37:32.559028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:33.052532 run create_hlr_db(pid=518): Launched 09:37:33.181448 bus /gobi_6: Setting Powered False 09:37:34.244177 run create_hlr_db(pid=518): Terminated: ok {rc=0} 09:37:34.665165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=520): Launched 09:37:34.958556 run osmo-hlr_10.42.42.2(pid=521): Launched 09:37:35.071335 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:35.590828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=523): Launched 09:37:35.885136 run osmo-stp_10.42.42.5(pid=524): Launched 09:37:35.997081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:36.503204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=526): Launched 09:37:36.616277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:36.864158 run patchelf(pid=527): Launched 09:37:37.028171 run osmo-stp_10.42.42.5(pid=524): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=524)] 09:37:37.152659 run osmo-stp_10.42.42.5(pid=524): stdout: | (launched: 2022-12-13_09:37:35.830847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:37.278751 run osmo-stp_10.42.42.5(pid=524): stderr: | 20221213093736000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093736000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093736000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093736001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093736001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093736001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093736001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:37.404778 run osmo-stp_10.42.42.5(pid=524): stdout: | (launched: 2022-12-13_09:37:35.830847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:37.525894 run osmo-stp_10.42.42.5(pid=524): stderr: | 20221213093736000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093736000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093736000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093736001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093736001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093736001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093736001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:37.669423 run patchelf(pid=527): Terminating (SIGINT) 09:37:37.834066 run patchelf(pid=527): Terminated: ok {rc=0} 09:37:37.953421 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=524): Process ended prematurely: osmo-stp_10.42.42.5(pid=524) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=524)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:37:37.962348 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:37:37.988478 run osmo-hlr_10.42.42.2(pid=521): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=521)] 09:37:38.037214 run osmo-hlr_10.42.42.2(pid=521): stdout: | (launched: 2022-12-13_09:37:34.904475) 09:37:38.087224 run osmo-hlr_10.42.42.2(pid=521): stderr: | 20221213093735077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093735077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093735077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093735078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093735078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093735078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093735089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093735098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093735098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093735098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:38.137064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=520): Terminating (SIGTERM) 09:37:38.176560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=523): Terminating (SIGTERM) 09:37:38.216095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=526): Terminating (SIGTERM) 09:37:38.255857 --- ParallelTerminationStrategy: PID 520 died... 09:37:38.275459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=520): Terminated: ok {rc=0} 09:37:38.319624 --- ParallelTerminationStrategy: PID 523 died... 09:37:38.338597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=523): Terminated: ok {rc=0} 09:37:38.382804 --- ParallelTerminationStrategy: PID 526 died... 09:37:38.402024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=526): Terminated: ok {rc=0} 09:37:38.488097 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:37:39.776893 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:37:39.783747 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:37:39.807076 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:37:39.846068 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:37:39.934803 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:37:39.961865 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:37:40.000233 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:37:40.588515 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:37:40.637573 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.648557 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:37:40.707458 tst cs_paging_gprs_active.py: using LAC 33078 09:37:40.826452 tst cs_paging_gprs_active.py: using RAC 183 09:37:40.942873 tst cs_paging_gprs_active.py: using CellId 33078 09:37:41.060458 tst cs_paging_gprs_active.py: using BVCI 33079 09:37:41.169229 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.180385 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.191413 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.202420 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.213856 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.225339 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.236737 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.248169 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:41.259672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:41.380763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:41.498628 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:37:41.699789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:41.998984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=531): Launched 09:37:42.258439 run iperf3-srv_10.42.42.10(pid=532): Launched 09:37:42.370687 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:37:42.570272 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:42.869401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=533): Launched 09:37:43.129137 run iperf3-srv_10.42.42.10(pid=534): Launched 09:37:43.241180 tst cs_paging_gprs_active.py:38: start network... 09:37:43.440369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:43.901499 run create_hlr_db(pid=535): Launched 09:37:44.015230 bus /gobi_6: Setting Powered False 09:37:45.075776 run create_hlr_db(pid=535): Terminated: ok {rc=0} 09:37:45.510559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=537): Launched 09:37:45.828791 run osmo-hlr_10.42.42.2(pid=538): Launched 09:37:46.061207 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:46.746970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=540): Launched 09:37:47.066811 run osmo-stp_10.42.42.5(pid=541): Launched 09:37:47.236818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:47.918232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=543): Launched 09:37:48.032388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:48.284796 run patchelf(pid=544): Launched 09:37:48.451372 run osmo-stp_10.42.42.5(pid=541): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=541)] 09:37:48.577835 run osmo-stp_10.42.42.5(pid=541): stdout: | (launched: 2022-12-13_09:37:47.004422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:48.706389 run osmo-stp_10.42.42.5(pid=541): stderr: | 20221213093747308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093747308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093747308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093747309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093747309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093747309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093747309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:48.834733 run osmo-stp_10.42.42.5(pid=541): stdout: | (launched: 2022-12-13_09:37:47.004422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:48.957524 run osmo-stp_10.42.42.5(pid=541): stderr: | 20221213093747308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093747308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093747308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093747309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093747309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093747309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093747309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:49.103270 run patchelf(pid=544): Terminating (SIGINT) 09:37:49.271014 run patchelf(pid=544): Terminated: ok {rc=0} 09:37:49.392254 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=541): Process ended prematurely: osmo-stp_10.42.42.5(pid=541) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=541)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:37:49.402138 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:37:49.429330 run osmo-hlr_10.42.42.2(pid=538): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=538)] 09:37:49.477709 run osmo-hlr_10.42.42.2(pid=538): stdout: | (launched: 2022-12-13_09:37:45.771363) 09:37:49.527261 run osmo-hlr_10.42.42.2(pid=538): stderr: | 20221213093746040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093746041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093746041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093746041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093746041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093746041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093746058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093746075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093746075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093746075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:49.577446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=531): Terminating (SIGTERM) 09:37:49.617589 run iperf3-srv_10.42.42.10(pid=532): Terminating (SIGTERM) 09:37:49.657644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=533): Terminating (SIGTERM) 09:37:49.697617 run iperf3-srv_10.42.42.10(pid=534): Terminating (SIGTERM) 09:37:49.737471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=537): Terminating (SIGTERM) 09:37:49.777467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=540): Terminating (SIGTERM) 09:37:49.817384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=543): Terminating (SIGTERM) 09:37:49.857799 --- ParallelTerminationStrategy: PID 531 died... 09:37:49.877104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=531): Terminated: ok {rc=0} 09:37:49.921094 --- ParallelTerminationStrategy: PID 532 died... 09:37:49.939593 run iperf3-srv_10.42.42.10(pid=532): Terminated {rc=256} 09:37:49.983247 --- ParallelTerminationStrategy: PID 533 died... 09:37:50.001916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=533): Terminated: ok {rc=0} 09:37:50.045559 --- ParallelTerminationStrategy: PID 534 died... 09:37:50.064155 run iperf3-srv_10.42.42.10(pid=534): Terminated {rc=256} 09:37:50.107491 --- ParallelTerminationStrategy: PID 537 died... 09:37:50.126115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=537): Terminated: ok {rc=0} 09:37:50.169496 --- ParallelTerminationStrategy: PID 540 died... 09:37:50.188139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=540): Terminated: ok {rc=0} 09:37:50.231441 --- ParallelTerminationStrategy: PID 543 died... 09:37:50.250172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=543): Terminated: ok {rc=0} 09:37:50.335353 bus /gobi_0: Setting Powered False 09:37:51.433039 bus /gobi_0: Setting Powered False 09:37:52.545634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:37:53.689649 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:53.701288 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:37:53.764073 tst iperf3.py: using LAC 33079 09:37:53.881810 tst iperf3.py: using RAC 184 09:37:54.004237 tst iperf3.py: using CellId 33079 09:37:54.129660 tst iperf3.py: using BVCI 33080 09:37:54.244828 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.256528 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.268243 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.279679 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.291247 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.302661 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.314334 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.325608 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:54.337096 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:54.453212 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:37:54.653958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:54.952890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=545): Launched 09:37:55.213074 run iperf3-srv_10.42.42.10(pid=546): Launched 09:37:55.325425 tst iperf3.py:8: start network... 09:37:55.525051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:55.985179 run create_hlr_db(pid=547): Launched 09:37:56.099994 bus /gobi_6: Setting Powered False 09:37:57.159181 run create_hlr_db(pid=547): Terminated: ok {rc=0} 09:37:57.593383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Launched 09:37:57.910416 run osmo-hlr_10.42.42.2(pid=550): Launched 09:37:58.031506 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:58.580516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Launched 09:37:58.898658 run osmo-stp_10.42.42.5(pid=553): Launched 09:37:59.019949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:59.568010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=555): Launched 09:37:59.689414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:59.957113 run patchelf(pid=556): Launched 09:38:00.134381 run osmo-stp_10.42.42.5(pid=553): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] 09:38:00.268934 run osmo-stp_10.42.42.5(pid=553): stdout: | (launched: 2022-12-13_09:37:58.840703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:00.405347 run osmo-stp_10.42.42.5(pid=553): stderr: | 20221213093759032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093759032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093759032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093759033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093759033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093759033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093759033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:00.541733 run osmo-stp_10.42.42.5(pid=553): stdout: | (launched: 2022-12-13_09:37:58.840703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:00.672534 run osmo-stp_10.42.42.5(pid=553): stderr: | 20221213093759032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093759032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093759032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093759033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093759033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093759033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093759033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:00.827376 run patchelf(pid=556): Terminating (SIGINT) 09:38:01.003378 run patchelf(pid=556): Terminated: ok {rc=0} 09:38:01.128401 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=553): Process ended prematurely: osmo-stp_10.42.42.5(pid=553) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:38:01.139730 tst iperf3.py:8: Test FAILED (7.5 sec) 09:38:01.168467 run osmo-hlr_10.42.42.2(pid=550): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=550)] 09:38:01.219833 run osmo-hlr_10.42.42.2(pid=550): stdout: | (launched: 2022-12-13_09:37:57.852737) 09:38:01.271446 run osmo-hlr_10.42.42.2(pid=550): stderr: | 20221213093758051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093758051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093758051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093758051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093758051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093758051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093758064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093758072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093758072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093758072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:01.324057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=545): Terminating (SIGTERM) 09:38:01.368046 run iperf3-srv_10.42.42.10(pid=546): Terminating (SIGTERM) 09:38:01.411805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Terminating (SIGTERM) 09:38:01.454123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Terminating (SIGTERM) 09:38:01.498116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=555): Terminating (SIGTERM) 09:38:01.543743 --- ParallelTerminationStrategy: PID 545 died... 09:38:01.565057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=545): Terminated: ok {rc=0} 09:38:01.613917 --- ParallelTerminationStrategy: PID 546 died... 09:38:01.634628 run iperf3-srv_10.42.42.10(pid=546): Terminated {rc=256} 09:38:01.681773 --- ParallelTerminationStrategy: PID 549 died... 09:38:01.702372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Terminated: ok {rc=0} 09:38:01.749335 --- ParallelTerminationStrategy: PID 552 died... 09:38:01.769889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Terminated: ok {rc=0} 09:38:01.816105 --- ParallelTerminationStrategy: PID 555 died... 09:38:01.837132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=555): Terminated: ok {rc=0} 09:38:01.926773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:38:03.072169 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.083731 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:38:03.142969 tst iperf3m4.py: using LAC 33080 09:38:03.262736 tst iperf3m4.py: using RAC 185 09:38:03.380725 tst iperf3m4.py: using CellId 33080 09:38:03.496706 tst iperf3m4.py: using BVCI 33081 09:38:03.604645 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.615619 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.626422 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.637191 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.648032 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.659027 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.670204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.681109 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:03.692432 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:38:03.808362 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:38:03.929558 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:38:04.046988 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:38:04.167950 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:38:04.383747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:04.703252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=557): Launched 09:38:04.979782 run iperf3-srv_10.42.42.10(pid=558): Launched 09:38:05.099998 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:38:05.315731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:05.634950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=559): Launched 09:38:05.911477 run iperf3-srv_10.42.42.10(pid=560): Launched 09:38:06.031171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:38:06.247051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:06.565860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=561): Launched 09:38:06.842221 run iperf3-srv_10.42.42.10(pid=562): Launched 09:38:06.961451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:38:07.176583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:07.496006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=563): Launched 09:38:07.771856 run iperf3-srv_10.42.42.10(pid=564): Launched 09:38:07.890600 tst iperf3m4.py:8: start network... 09:38:08.105167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:08.600683 run create_hlr_db(pid=565): Launched 09:38:08.730181 bus /gobi_6: Setting Powered False 09:38:09.789258 run create_hlr_db(pid=565): Terminated: ok {rc=0} 09:38:10.230692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=567): Launched 09:38:10.548077 run osmo-hlr_10.42.42.2(pid=568): Launched 09:38:10.669774 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:11.218181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=570): Launched 09:38:11.534831 run osmo-stp_10.42.42.5(pid=571): Launched 09:38:11.652935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:12.167891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=573): Launched 09:38:12.281869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:12.534871 run patchelf(pid=574): Launched 09:38:12.700554 run osmo-stp_10.42.42.5(pid=571): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=571)] 09:38:12.826723 run osmo-stp_10.42.42.5(pid=571): stdout: | (launched: 2022-12-13_09:38:11.477287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:12.954584 run osmo-stp_10.42.42.5(pid=571): stderr: | 20221213093811646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093811646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093811646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093811647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093811649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093811649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093811649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:13.082185 run osmo-stp_10.42.42.5(pid=571): stdout: | (launched: 2022-12-13_09:38:11.477287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:13.204755 run osmo-stp_10.42.42.5(pid=571): stderr: | 20221213093811646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093811646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093811646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093811647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093811649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093811649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093811649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:13.350214 run patchelf(pid=574): Terminating (SIGINT) 09:38:13.518258 run patchelf(pid=574): Terminated: ok {rc=0} 09:38:13.639247 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=571): Process ended prematurely: osmo-stp_10.42.42.5(pid=571) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=571)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:38:13.648811 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:38:13.676009 run osmo-hlr_10.42.42.2(pid=568): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=568)] 09:38:13.724089 run osmo-hlr_10.42.42.2(pid=568): stdout: | (launched: 2022-12-13_09:38:10.490180) 09:38:13.773782 run osmo-hlr_10.42.42.2(pid=568): stderr: | 20221213093810690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093810691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093810691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093810691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093810691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093810691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093810704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093810712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093810712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093810712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:13.823787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=557): Terminating (SIGTERM) 09:38:13.863600 run iperf3-srv_10.42.42.10(pid=558): Terminating (SIGTERM) 09:38:13.903607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=559): Terminating (SIGTERM) 09:38:13.943596 run iperf3-srv_10.42.42.10(pid=560): Terminating (SIGTERM) 09:38:13.983358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=561): Terminating (SIGTERM) 09:38:14.023275 run iperf3-srv_10.42.42.10(pid=562): Terminating (SIGTERM) 09:38:14.063100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=563): Terminating (SIGTERM) 09:38:14.102874 run iperf3-srv_10.42.42.10(pid=564): Terminating (SIGTERM) 09:38:14.142554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=567): Terminating (SIGTERM) 09:38:14.182279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=570): Terminating (SIGTERM) 09:38:14.222093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=573): Terminating (SIGTERM) 09:38:14.262293 --- ParallelTerminationStrategy: PID 557 died... 09:38:14.281839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=557): Terminated: ok {rc=0} 09:38:14.326002 --- ParallelTerminationStrategy: PID 558 died... 09:38:14.345218 run iperf3-srv_10.42.42.10(pid=558): Terminated {rc=256} 09:38:14.389260 --- ParallelTerminationStrategy: PID 559 died... 09:38:14.408195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=559): Terminated: ok {rc=0} 09:38:14.452489 --- ParallelTerminationStrategy: PID 560 died... 09:38:14.471591 run iperf3-srv_10.42.42.10(pid=560): Terminated {rc=256} 09:38:14.515721 --- ParallelTerminationStrategy: PID 561 died... 09:38:14.534942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=561): Terminated: ok {rc=0} 09:38:14.578755 --- ParallelTerminationStrategy: PID 562 died... 09:38:14.598229 run iperf3-srv_10.42.42.10(pid=562): Terminated {rc=256} 09:38:14.642155 --- ParallelTerminationStrategy: PID 563 died... 09:38:14.661324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=563): Terminated: ok {rc=0} 09:38:14.705346 --- ParallelTerminationStrategy: PID 564 died... 09:38:14.724483 run iperf3-srv_10.42.42.10(pid=564): Terminated {rc=256} 09:38:14.768272 --- ParallelTerminationStrategy: PID 567 died... 09:38:14.787299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=567): Terminated: ok {rc=0} 09:38:14.831192 --- ParallelTerminationStrategy: PID 570 died... 09:38:14.850308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=570): Terminated: ok {rc=0} 09:38:14.894018 --- ParallelTerminationStrategy: PID 573 died... 09:38:14.913091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=573): Terminated: ok {rc=0} 09:38:14.998955 bus /gobi_4: Setting Powered False 09:38:16.116648 bus /gobi_4: Setting Powered False 09:38:17.250247 bus /gobi_1: Setting Powered False 09:38:18.346347 bus /gobi_1: Setting Powered False 09:38:19.460450 bus /gobi_0: Setting Powered False 09:38:20.558660 bus /gobi_0: Setting Powered False 09:38:21.675449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:38:22.778111 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:22.789706 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:38:22.850655 tst ping.py: using LAC 33081 09:38:22.966594 tst ping.py: using RAC 186 09:38:23.080470 tst ping.py: using CellId 33081 09:38:23.198101 tst ping.py: using BVCI 33082 09:38:23.305534 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:23.316563 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:23.327375 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:23.338323 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:23.349311 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:23.360427 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:23.371724 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:23.382783 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:38:23.496647 tst ping.py:19: start network... 09:38:23.692658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:24.145032 run create_hlr_db(pid=575): Launched 09:38:24.256542 bus /gobi_6: Setting Powered False 09:38:25.315741 run create_hlr_db(pid=575): Terminated: ok {rc=0} 09:38:25.744913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Launched 09:38:26.058269 run osmo-hlr_10.42.42.2(pid=578): Launched 09:38:26.178567 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:26.726390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Launched 09:38:27.038880 run osmo-stp_10.42.42.5(pid=581): Launched 09:38:27.158886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:27.699215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=583): Launched 09:38:27.818873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:28.082772 run patchelf(pid=584): Launched 09:38:28.256366 run osmo-stp_10.42.42.5(pid=581): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] 09:38:28.388927 run osmo-stp_10.42.42.5(pid=581): stdout: | (launched: 2022-12-13_09:38:26.981947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:28.523110 run osmo-stp_10.42.42.5(pid=581): stderr: | 20221213093827173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093827173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093827174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093827174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093827174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093827174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093827175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:28.657164 run osmo-stp_10.42.42.5(pid=581): stdout: | (launched: 2022-12-13_09:38:26.981947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:28.785747 run osmo-stp_10.42.42.5(pid=581): stderr: | 20221213093827173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093827173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093827174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093827174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093827174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093827174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093827175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:28.937613 run patchelf(pid=584): Terminating (SIGINT) 09:38:29.113611 run patchelf(pid=584): Terminated: ok {rc=0} 09:38:29.239621 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=581): Process ended prematurely: osmo-stp_10.42.42.5(pid=581) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 09:38:29.249279 tst ping.py:22: Test FAILED (6.5 sec) 09:38:29.277057 run osmo-hlr_10.42.42.2(pid=578): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=578)] 09:38:29.326598 run osmo-hlr_10.42.42.2(pid=578): stdout: | (launched: 2022-12-13_09:38:26.001469) 09:38:29.377553 run osmo-hlr_10.42.42.2(pid=578): stderr: | 20221213093826198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093826198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093826198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093826198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093826198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093826198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093826211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093826219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093826219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093826219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:29.429535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Terminating (SIGTERM) 09:38:29.470841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Terminating (SIGTERM) 09:38:29.512202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=583): Terminating (SIGTERM) 09:38:29.553808 --- ParallelTerminationStrategy: PID 577 died... 09:38:29.573809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Terminated: ok {rc=0} 09:38:29.619757 --- ParallelTerminationStrategy: PID 580 died... 09:38:29.639360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Terminated: ok {rc=0} 09:38:29.685435 --- ParallelTerminationStrategy: PID 583 died... 09:38:29.705127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=583): Terminated: ok {rc=0} 09:38:29.792409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:38:30.887350 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:30.899356 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:38:30.976357 tst ping_idle_ping.py: using LAC 33082 09:38:31.101241 tst ping_idle_ping.py: using RAC 187 09:38:31.221308 tst ping_idle_ping.py: using CellId 33082 09:38:31.378562 tst ping_idle_ping.py: using BVCI 33083 09:38:31.498353 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:31.511115 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:31.523198 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:31.535295 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:31.547825 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:31.560125 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:31.572487 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:38:31.584550 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:38:31.711872 tst ping_idle_ping.py:24: start network... 09:38:31.953191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:32.433668 run create_hlr_db(pid=585): Launched 09:38:32.546806 bus /gobi_6: Setting Powered False 09:38:33.605151 run create_hlr_db(pid=585): Terminated: ok {rc=0} 09:38:34.033290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=587): Launched 09:38:34.348410 run osmo-hlr_10.42.42.2(pid=588): Launched 09:38:34.468095 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:35.007475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=590): Launched 09:38:35.320699 run osmo-stp_10.42.42.5(pid=591): Launched 09:38:35.440868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:35.981944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=593): Launched 09:38:36.102067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:36.366280 run patchelf(pid=594): Launched 09:38:36.539838 run osmo-stp_10.42.42.5(pid=591): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=591)] 09:38:36.673131 run osmo-stp_10.42.42.5(pid=591): stdout: | (launched: 2022-12-13_09:38:35.263665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:36.807465 run osmo-stp_10.42.42.5(pid=591): stderr: | 20221213093835454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093835454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093835454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093835454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093835455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093835455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093835455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:36.942278 run osmo-stp_10.42.42.5(pid=591): stdout: | (launched: 2022-12-13_09:38:35.263665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:37.071131 run osmo-stp_10.42.42.5(pid=591): stderr: | 20221213093835454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093835454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093835454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093835454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093835455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093835455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093835455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:37.224002 run patchelf(pid=594): Terminating (SIGINT) 09:38:37.399526 run patchelf(pid=594): Terminated: ok {rc=0} 09:38:37.526758 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=591): Process ended prematurely: osmo-stp_10.42.42.5(pid=591) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=591)] [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:38:37.536219 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:38:37.563887 run osmo-hlr_10.42.42.2(pid=588): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=588)] 09:38:37.613327 run osmo-hlr_10.42.42.2(pid=588): stdout: | (launched: 2022-12-13_09:38:34.291461) 09:38:37.664424 run osmo-hlr_10.42.42.2(pid=588): stderr: | 20221213093834487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093834487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093834487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093834487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093834487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093834488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093834499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093834507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093834507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093834508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:37.715913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=587): Terminating (SIGTERM) 09:38:37.757483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=590): Terminating (SIGTERM) 09:38:37.799064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=593): Terminating (SIGTERM) 09:38:37.840877 --- ParallelTerminationStrategy: PID 587 died... 09:38:37.861036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=587): Terminated: ok {rc=0} 09:38:37.906989 --- ParallelTerminationStrategy: PID 590 died... 09:38:37.926520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=590): Terminated: ok {rc=0} 09:38:37.972192 --- ParallelTerminationStrategy: PID 593 died... 09:38:37.991574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=593): Terminated: ok {rc=0} 09:38:38.078571 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:38:39.374817 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:39.382809 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:38:39.406984 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:38:39.442080 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:38:39.494233 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:38:39.518893 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:38:39.554328 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:38:40.115554 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:38:40.121653 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.133841 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:38:40.191970 tst switch_tch_pdch.py: using LAC 33083 09:38:40.305681 tst switch_tch_pdch.py: using RAC 188 09:38:40.429851 tst switch_tch_pdch.py: using CellId 33083 09:38:40.551311 tst switch_tch_pdch.py: using BVCI 33084 09:38:40.665134 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.677339 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.689245 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.701150 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.713531 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.725855 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.738439 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:40.750803 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:38:40.867852 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:38:40.987898 tst switch_tch_pdch.py:51: start network... 09:38:41.199264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:41.683812 run create_hlr_db(pid=600): Launched 09:38:41.810456 bus /gobi_6: Setting Powered False 09:38:42.872398 run create_hlr_db(pid=600): Terminated: ok {rc=0} 09:38:43.307838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=602): Launched 09:38:43.620540 run osmo-hlr_10.42.42.2(pid=603): Launched 09:38:43.734357 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:44.247465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=605): Launched 09:38:44.538613 run osmo-stp_10.42.42.5(pid=606): Launched 09:38:44.650340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:45.154161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=608): Launched 09:38:45.266203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:45.512320 run patchelf(pid=609): Launched 09:38:45.674846 run osmo-stp_10.42.42.5(pid=606): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=606)] 09:38:45.798990 run osmo-stp_10.42.42.5(pid=606): stdout: | (launched: 2022-12-13_09:38:44.484728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:45.948478 run osmo-stp_10.42.42.5(pid=606): stderr: | 20221213093844652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093844653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093844653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093844653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093844654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093844654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093844654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:46.076222 run osmo-stp_10.42.42.5(pid=606): stdout: | (launched: 2022-12-13_09:38:44.484728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:46.199450 run osmo-stp_10.42.42.5(pid=606): stderr: | 20221213093844652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093844653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093844653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093844653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093844654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093844654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093844654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:46.344677 run patchelf(pid=609): Terminating (SIGINT) 09:38:46.512330 run patchelf(pid=609): Terminated: ok {rc=0} 09:38:46.634261 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=606): Process ended prematurely: osmo-stp_10.42.42.5(pid=606) [trial-2387↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=606)] [trial-2387↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:38:46.643859 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 09:38:46.671154 run osmo-hlr_10.42.42.2(pid=603): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=603)] 09:38:46.734510 run osmo-hlr_10.42.42.2(pid=603): stdout: | (launched: 2022-12-13_09:38:43.563645) 09:38:46.798160 run osmo-hlr_10.42.42.2(pid=603): stderr: | 20221213093843740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093843740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093843740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093843740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093843740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093843740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093843752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093843761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093843761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093843761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:46.859060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=602): Terminating (SIGTERM) 09:38:46.907829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=605): Terminating (SIGTERM) 09:38:46.960884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=608): Terminating (SIGTERM) 09:38:47.006827 --- ParallelTerminationStrategy: PID 602 died... 09:38:47.030881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=602): Terminated: ok {rc=0} 09:38:47.086500 --- ParallelTerminationStrategy: PID 605 died... 09:38:47.107568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=605): Terminated: ok {rc=0} 09:38:47.166541 --- ParallelTerminationStrategy: PID 608 died... 09:38:47.190431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=608): Terminated: ok {rc=0} 09:38:47.300182 bus /gobi_0: Setting Powered False 09:38:48.422718 bus /gobi_0: Setting Powered False 09:38:49.552878 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 sms:nanobts+band-900 --------------------------------------------------------------------- 09:38:50.803670 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:50.808763 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:38:50.841042 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:38:50.869618 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 09:38:50.920738 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:38:50.953288 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:38:50.981537 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 09:38:51.526576 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 09:38:51.534191 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:38:51.545749 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 09:38:51.596240 tst mo_mt_sms.py: using LAC 33084 09:38:51.713116 tst mo_mt_sms.py: using RAC 189 09:38:51.830717 tst mo_mt_sms.py: using CellId 33084 09:38:51.950005 tst mo_mt_sms.py: using BVCI 33085 09:38:52.059426 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:38:52.071228 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:38:52.082889 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:38:52.094348 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:38:52.107270 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:38:52.120722 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:38:52.241983 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:38:52.361184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:52.830024 run create_hlr_db(pid=904): Launched 09:38:52.986535 bus /gobi_6: Setting Powered False 09:38:54.046916 run create_hlr_db(pid=904): Terminated: ok {rc=0} 09:38:54.488443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=906): Launched 09:38:54.819385 run osmo-hlr_10.42.42.2(pid=907): Launched 09:38:55.056290 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:55.721675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Launched 09:38:56.048567 run osmo-stp_10.42.42.5(pid=910): Launched 09:38:56.284309 run osmo-msc_10.42.42.6: Starting osmo-msc 09:38:56.952882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=912): Launched 09:38:57.285784 run osmo-msc_10.42.42.6(pid=913): Launched 09:38:57.636744 run osmo-stp_10.42.42.5(pid=910): ERR: Terminated: ERROR {rc=1} [trial-2387↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] 09:38:57.912129 run osmo-stp_10.42.42.5(pid=910): stdout: | (launched: 2022-12-13_09:38:55.986543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:58.095415 run osmo-stp_10.42.42.5(pid=910): stderr: | 20221213093856288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093856288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093856288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093856288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093856289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093856289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093856289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:58.229595 run osmo-stp_10.42.42.5(pid=910): stdout: | (launched: 2022-12-13_09:38:55.986543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:58.357255 run osmo-stp_10.42.42.5(pid=910): stderr: | 20221213093856288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093856288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093856288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093856288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093856289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093856289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093856289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:58.509511 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=910): Process ended prematurely: osmo-stp_10.42.42.5(pid=910) [trial-2387↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] [trial-2387↪sms:nanobts+band-900↪mo_mt_sms.py:16] 09:38:58.519348 tst mo_mt_sms.py:16: Test FAILED (7.0 sec) 09:38:58.547818 run osmo-hlr_10.42.42.2(pid=907): ERR: Terminated: ERROR {rc=237} [trial-2387↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=907)] 09:38:58.599138 run osmo-hlr_10.42.42.2(pid=907): stdout: | (launched: 2022-12-13_09:38:54.757333) 09:38:58.652908 run osmo-hlr_10.42.42.2(pid=907): stderr: | 20221213093855066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093855066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093855066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093855066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093855066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093855066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093855086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093855094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093855095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093855095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:58.726540 run osmo-msc_10.42.42.6(pid=913): ERR: Terminated: ERROR {rc=2} [trial-2387↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=913)] 09:38:58.777445 run osmo-msc_10.42.42.6(pid=913): stdout: | (launched: 2022-12-13_09:38:57.224371) 09:38:58.830148 run osmo-msc_10.42.42.6(pid=913): stderr: | 20221213093857730 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093857730 DLGLOBAL DEBUG validating counter group 0x7f89a2845c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093857730 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093857730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093857730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093857731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093857732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093857737 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093857737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093857737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:38:58.884923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=906): Terminating (SIGTERM) 09:38:58.928094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Terminating (SIGTERM) 09:38:58.983205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=912): Terminating (SIGTERM) 09:38:59.028535 --- ParallelTerminationStrategy: PID 906 died... 09:38:59.050506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=906): Terminated: ok {rc=0} 09:38:59.099820 --- ParallelTerminationStrategy: PID 909 died... 09:38:59.121051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Terminated: ok {rc=0} 09:38:59.169781 --- ParallelTerminationStrategy: PID 912 died... 09:38:59.190963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=912): Terminated: ok {rc=0} 09:38:59.281520 bus /sierra_3: Setting Powered False 09:39:00.385168 bus /sierra_3: Setting Powered False 09:39:01.532661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 09:39:02.797103 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:02.803001 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:39:02.837248 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 09:39:02.846532 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:39:02.882557 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:39:02.916576 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 09:39:02.924101 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:39:03.444505 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:39:03.451697 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 09:39:03.464041 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:39:03.517800 tst assert_extension.py: using LAC 33085 09:39:03.645413 tst assert_extension.py: using RAC 190 09:39:03.771518 tst assert_extension.py: using CellId 33085 09:39:03.895722 tst assert_extension.py: using BVCI 33086 09:39:04.013745 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:39:04.136512 tst assert_extension.py:10: start nitb and bts... 09:39:04.356115 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:39:05.026484 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=924): Launched 09:39:05.365315 run osmo-nitb_10.42.42.2(pid=925): Launched 09:39:05.563664 run osmo-nitb_10.42.42.2(pid=925): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=925)] 09:39:05.709902 run osmo-nitb_10.42.42.2(pid=925): stdout: | (launched: 2022-12-13_09:39:05.301969) 09:39:05.858150 run osmo-nitb_10.42.42.2(pid=925): stderr: | (launched: 2022-12-13_09:39:05.350493) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:06.006143 run osmo-nitb_10.42.42.2(pid=925): stdout: | (launched: 2022-12-13_09:39:05.301969) 09:39:06.148301 run osmo-nitb_10.42.42.2(pid=925): stderr: | (launched: 2022-12-13_09:39:05.350493) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=925): Process ended prematurely: osmo-nitb_10.42.42.2(pid=925) [trial-2387↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=925)] 09:39:06.505896 tst osmo-nitb_10.42.42.2(pid=925): stdout: | (launched: 2022-12-13_09:39:05.301969) 09:39:06.640772 tst osmo-nitb_10.42.42.2(pid=925): stderr: | (launched: 2022-12-13_09:39:05.350493) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:06.797181 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=925): Process ended prematurely: osmo-nitb_10.42.42.2(pid=925) [trial-2387↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=925)] [trial-2387↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 09:39:06.807730 tst assert_extension.py:12: Test FAILED (3.3 sec) 09:39:06.815749 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=924): Terminating (SIGTERM) 09:39:07.029250 --- ParallelTerminationStrategy: PID 924 died... 09:39:07.051833 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=924): Terminated: ok {rc=0} 09:39:07.144146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 ussd:nanobts+band-900 --------------------------------------------------------------------- 09:39:08.322681 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:08.327402 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:39:08.368025 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:39:08.395737 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:39:08.431491 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:39:08.464154 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:39:08.491167 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:39:09.022021 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:39:09.027360 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:39:09.038719 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:39:09.085203 tst assert_extension.py: using LAC 33086 09:39:09.208332 tst assert_extension.py: using RAC 191 09:39:09.330628 tst assert_extension.py: using CellId 33086 09:39:09.454507 tst assert_extension.py: using BVCI 33087 09:39:09.567434 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:39:09.578805 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:39:09.590362 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:39:09.601446 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:39:09.612467 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:39:09.623418 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:39:09.737542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:10.190789 run create_hlr_db(pid=930): Launched 09:39:10.302426 bus /sierra_2: Setting Powered False 09:39:11.361370 run create_hlr_db(pid=930): Terminated: ok {rc=0} 09:39:11.789616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=932): Launched 09:39:12.101545 run osmo-hlr_10.42.42.2(pid=933): Launched 09:39:12.221367 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:12.762472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=936): Launched 09:39:13.074459 run osmo-stp_10.42.42.5(pid=937): Launched 09:39:13.193842 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:13.757522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=939): Launched 09:39:14.068385 run osmo-msc_10.42.42.6(pid=940): Launched 09:39:14.243091 run osmo-stp_10.42.42.5(pid=937): ERR: Terminated: ERROR {rc=1} [trial-2387↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=937)] 09:39:14.375497 run osmo-stp_10.42.42.5(pid=937): stdout: | (launched: 2022-12-13_09:39:13.017677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:14.508203 run osmo-stp_10.42.42.5(pid=937): stderr: | 20221213093913210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093913210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093913210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093913211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093913211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093913211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093913211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:14.639738 run osmo-stp_10.42.42.5(pid=937): stdout: | (launched: 2022-12-13_09:39:13.017677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:14.764375 run osmo-stp_10.42.42.5(pid=937): stderr: | 20221213093913210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093913210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093913210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093913211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093913211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093913211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093913211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:14.913382 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=937): Process ended prematurely: osmo-stp_10.42.42.5(pid=937) [trial-2387↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=937)] [trial-2387↪ussd:nanobts+band-900↪assert_extension.py:17] 09:39:14.922132 tst assert_extension.py:17: Test FAILED (5.9 sec) 09:39:14.949171 run osmo-hlr_10.42.42.2(pid=933): ERR: Terminated: ERROR {rc=237} [trial-2387↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=933)] 09:39:14.999025 run osmo-hlr_10.42.42.2(pid=933): stdout: | (launched: 2022-12-13_09:39:12.044456) 09:39:15.050778 run osmo-hlr_10.42.42.2(pid=933): stderr: | 20221213093912243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093912243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093912243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093912243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093912243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093912243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093912255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093912265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093912265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093912265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:15.123648 run osmo-msc_10.42.42.6(pid=940): ERR: Terminated: ERROR {rc=2} [trial-2387↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=940)] 09:39:15.173768 run osmo-msc_10.42.42.6(pid=940): stdout: | (launched: 2022-12-13_09:39:14.011545) 09:39:15.226029 run osmo-msc_10.42.42.6(pid=940): stderr: | 20221213093914334 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093914334 DLGLOBAL DEBUG validating counter group 0x7faedcadcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093914334 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093914334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093914334 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093914335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093914336 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093914337 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093914337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093914337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:15.277957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=932): Terminating (SIGTERM) 09:39:15.319362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=936): Terminating (SIGTERM) 09:39:15.360779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=939): Terminating (SIGTERM) 09:39:15.402412 --- ParallelTerminationStrategy: PID 932 died... 09:39:15.422322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=932): Terminated: ok {rc=0} 09:39:15.467791 --- ParallelTerminationStrategy: PID 936 died... 09:39:15.487076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=936): Terminated: ok {rc=0} 09:39:15.532522 --- ParallelTerminationStrategy: PID 939 died... 09:39:15.551835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=939): Terminated: ok {rc=0} 09:39:15.638047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:39:16.870643 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:16.879327 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:39:16.913929 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:39:16.942226 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:39:16.997266 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:39:17.047322 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:39:17.093370 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:39:17.610761 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:39:17.662264 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:17.673834 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:39:17.740887 tst mo_mt_call.py: using LAC 33087 09:39:17.865443 tst mo_mt_call.py: using RAC 192 09:39:17.983807 tst mo_mt_call.py: using CellId 33087 09:39:18.102844 tst mo_mt_call.py: using BVCI 33088 09:39:18.212934 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:18.224204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:18.235453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:18.246625 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:18.258999 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:18.270992 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:39:18.393495 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:39:18.511205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:18.972787 run create_hlr_db(pid=945): Launched 09:39:19.086514 bus /sierra_2: Setting Powered False 09:39:20.146388 run create_hlr_db(pid=945): Terminated: ok {rc=0} 09:39:20.581949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=947): Launched 09:39:20.898572 run osmo-hlr_10.42.42.2(pid=948): Launched 09:39:21.020237 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:21.569846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=950): Launched 09:39:21.888104 run osmo-stp_10.42.42.5(pid=951): Launched 09:39:22.009995 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:22.586744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=954): Launched 09:39:22.904629 run osmo-msc_10.42.42.6(pid=955): Launched 09:39:23.082653 run osmo-stp_10.42.42.5(pid=951): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=951)] 09:39:23.217901 run osmo-stp_10.42.42.5(pid=951): stdout: | (launched: 2022-12-13_09:39:21.830242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:23.353287 run osmo-stp_10.42.42.5(pid=951): stderr: | 20221213093922022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093922022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093922022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093922023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093922023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093922023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093922023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:23.487508 run osmo-stp_10.42.42.5(pid=951): stdout: | (launched: 2022-12-13_09:39:21.830242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:23.614805 run osmo-stp_10.42.42.5(pid=951): stderr: | 20221213093922022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093922022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093922022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093922023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093922023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093922023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093922023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:23.766673 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=951): Process ended prematurely: osmo-stp_10.42.42.5(pid=951) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=951)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:39:23.775940 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:39:23.803598 run osmo-hlr_10.42.42.2(pid=948): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=948)] 09:39:23.854987 run osmo-hlr_10.42.42.2(pid=948): stdout: | (launched: 2022-12-13_09:39:20.841089) 09:39:23.907670 run osmo-hlr_10.42.42.2(pid=948): stderr: | 20221213093921037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093921037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093921038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093921038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093921038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093921038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093921050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093921059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093921059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093921059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:23.980846 run osmo-msc_10.42.42.6(pid=955): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=955)] 09:39:24.030429 run osmo-msc_10.42.42.6(pid=955): stdout: | (launched: 2022-12-13_09:39:22.846839) 09:39:24.082275 run osmo-msc_10.42.42.6(pid=955): stderr: | 20221213093923170 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093923170 DLGLOBAL DEBUG validating counter group 0x7f05fc12ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093923170 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093923170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093923170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093923170 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093923172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093923172 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093923173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093923173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:24.135855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=947): Terminating (SIGTERM) 09:39:24.177432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=950): Terminating (SIGTERM) 09:39:24.219388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=954): Terminating (SIGTERM) 09:39:24.261594 --- ParallelTerminationStrategy: PID 947 died... 09:39:24.281633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=947): Terminated: ok {rc=0} 09:39:24.328018 --- ParallelTerminationStrategy: PID 950 died... 09:39:24.348101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=950): Terminated: ok {rc=0} 09:39:24.394327 --- ParallelTerminationStrategy: PID 954 died... 09:39:24.414471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=954): Terminated: ok {rc=0} 09:39:24.503103 bus /sierra_3: Setting Powered False 09:39:25.601278 bus /sierra_3: Setting Powered False 09:39:26.717863 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:39:27.861908 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:27.873947 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:39:27.940070 tst mo_mt_call_osmux.py: using LAC 33088 09:39:28.058804 tst mo_mt_call_osmux.py: using RAC 193 09:39:28.175420 tst mo_mt_call_osmux.py: using CellId 33088 09:39:28.294194 tst mo_mt_call_osmux.py: using BVCI 33089 09:39:28.401964 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:28.412939 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:28.423956 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:28.434824 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:28.446142 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:39:28.457370 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:39:28.571316 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:39:28.685956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:29.149275 run create_hlr_db(pid=958): Launched 09:39:29.263303 bus /sierra_2: Setting Powered False 09:39:30.322643 run create_hlr_db(pid=958): Terminated: ok {rc=0} 09:39:30.760808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Launched 09:39:31.095314 run osmo-hlr_10.42.42.2(pid=961): Launched 09:39:31.367856 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:32.224672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=963): Launched 09:39:32.592298 run osmo-stp_10.42.42.5(pid=964): Launched 09:39:32.709140 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:33.248578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=966): Launched 09:39:33.548108 run osmo-msc_10.42.42.6(pid=967): Launched 09:39:33.717240 run osmo-stp_10.42.42.5(pid=964): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=964)] 09:39:33.844521 run osmo-stp_10.42.42.5(pid=964): stdout: | (launched: 2022-12-13_09:39:32.537430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:33.972322 run osmo-stp_10.42.42.5(pid=964): stderr: | 20221213093932705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093932705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093932706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093932706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093932708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093932708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093932709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:34.097172 run osmo-stp_10.42.42.5(pid=964): stdout: | (launched: 2022-12-13_09:39:32.537430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:34.216336 run osmo-stp_10.42.42.5(pid=964): stderr: | 20221213093932705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093932705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093932706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093932706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093932708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093932708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093932709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:34.359080 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=964): Process ended prematurely: osmo-stp_10.42.42.5(pid=964) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=964)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:39:34.368216 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:39:34.394472 run osmo-hlr_10.42.42.2(pid=961): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=961)] 09:39:34.442355 run osmo-hlr_10.42.42.2(pid=961): stdout: | (launched: 2022-12-13_09:39:31.029998) 09:39:34.491723 run osmo-hlr_10.42.42.2(pid=961): stderr: | 20221213093931378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093931378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093931378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093931378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093931378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093931378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093931394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093931420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093931421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093931421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:34.561958 run osmo-msc_10.42.42.6(pid=967): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=967)] 09:39:34.609690 run osmo-msc_10.42.42.6(pid=967): stdout: | (launched: 2022-12-13_09:39:33.493567) 09:39:34.659128 run osmo-msc_10.42.42.6(pid=967): stderr: | 20221213093933766 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093933767 DLGLOBAL DEBUG validating counter group 0x7f18ec616c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093933767 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093933767 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093933767 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093933767 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093933769 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093933769 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093933769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093933769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:34.709449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Terminating (SIGTERM) 09:39:34.749238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=963): Terminating (SIGTERM) 09:39:34.789122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=966): Terminating (SIGTERM) 09:39:34.829363 --- ParallelTerminationStrategy: PID 960 died... 09:39:34.849151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Terminated: ok {rc=0} 09:39:34.893197 --- ParallelTerminationStrategy: PID 963 died... 09:39:34.912080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=963): Terminated: ok {rc=0} 09:39:34.955922 --- ParallelTerminationStrategy: PID 966 died... 09:39:34.974926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=966): Terminated: ok {rc=0} 09:39:35.060255 bus /sierra_3: Setting Powered False 09:39:36.158409 bus /sierra_3: Setting Powered False 09:39:37.271817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:39:38.520679 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:38.528154 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:39:38.559582 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:39:38.587190 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:39:38.638876 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:39:38.671282 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:39:38.698029 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:39:39.246687 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:39:39.295974 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:39.307207 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:39:39.378273 tst mo_mt_call.py: using LAC 33089 09:39:39.496172 tst mo_mt_call.py: using RAC 194 09:39:39.611252 tst mo_mt_call.py: using CellId 33089 09:39:39.726104 tst mo_mt_call.py: using BVCI 33090 09:39:39.835489 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:39.846627 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:39.857656 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:39.868465 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:39.879662 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:39.890898 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:39:40.005612 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:39:40.124887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:40.617223 run create_hlr_db(pid=972): Launched 09:39:40.747728 bus /sierra_2: Setting Powered False 09:39:41.811462 run create_hlr_db(pid=972): Terminated: ok {rc=0} 09:39:42.236524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=974): Launched 09:39:42.534463 run osmo-hlr_10.42.42.2(pid=975): Launched 09:39:42.648867 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:43.174602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=977): Launched 09:39:43.472265 run osmo-stp_10.42.42.5(pid=978): Launched 09:39:43.586813 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:44.126566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=980): Launched 09:39:44.424219 run osmo-msc_10.42.42.6(pid=981): Launched 09:39:44.591826 run osmo-stp_10.42.42.5(pid=978): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=978)] 09:39:44.719392 run osmo-stp_10.42.42.5(pid=978): stdout: | (launched: 2022-12-13_09:39:43.417931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:44.845904 run osmo-stp_10.42.42.5(pid=978): stderr: | 20221213093943588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093943589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093943589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093943589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093943590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093943590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093943590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:44.970067 run osmo-stp_10.42.42.5(pid=978): stdout: | (launched: 2022-12-13_09:39:43.417931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:45.088835 run osmo-stp_10.42.42.5(pid=978): stderr: | 20221213093943588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093943589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093943589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093943589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093943590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093943590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093943590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:45.231468 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=978): Process ended prematurely: osmo-stp_10.42.42.5(pid=978) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=978)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:39:45.240356 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:39:45.266519 run osmo-hlr_10.42.42.2(pid=975): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=975)] 09:39:45.314533 run osmo-hlr_10.42.42.2(pid=975): stdout: | (launched: 2022-12-13_09:39:42.480223) 09:39:45.363394 run osmo-hlr_10.42.42.2(pid=975): stderr: | 20221213093942654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093942654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093942654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093942654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093942654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093942654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093942666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093942676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093942676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093942676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:45.432065 run osmo-msc_10.42.42.6(pid=981): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=981)] 09:39:45.479025 run osmo-msc_10.42.42.6(pid=981): stdout: | (launched: 2022-12-13_09:39:44.369810) 09:39:45.528633 run osmo-msc_10.42.42.6(pid=981): stderr: | 20221213093944641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093944641 DLGLOBAL DEBUG validating counter group 0x7ffa93615c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093944641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093944641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093944642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093944642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093944643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093944644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093944644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093944644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:45.578815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=974): Terminating (SIGTERM) 09:39:45.618465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=977): Terminating (SIGTERM) 09:39:45.657987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=980): Terminating (SIGTERM) 09:39:45.697808 --- ParallelTerminationStrategy: PID 974 died... 09:39:45.717332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=974): Terminated: ok {rc=0} 09:39:45.761288 --- ParallelTerminationStrategy: PID 977 died... 09:39:45.780112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=977): Terminated: ok {rc=0} 09:39:45.823991 --- ParallelTerminationStrategy: PID 980 died... 09:39:45.843252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=980): Terminated: ok {rc=0} 09:39:45.954200 bus /sierra_3: Setting Powered False 09:39:47.059682 bus /sierra_3: Setting Powered False 09:39:48.180410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:39:49.320728 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:49.332627 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:39:49.398353 tst mo_mt_call_osmux.py: using LAC 33090 09:39:49.514503 tst mo_mt_call_osmux.py: using RAC 195 09:39:49.630847 tst mo_mt_call_osmux.py: using CellId 33090 09:39:49.749854 tst mo_mt_call_osmux.py: using BVCI 33091 09:39:49.858746 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:49.870114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:49.881168 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:49.892186 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:49.903745 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:39:49.915114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:39:50.035256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:39:50.155130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:50.647998 run create_hlr_db(pid=983): Launched 09:39:50.777578 bus /sierra_2: Setting Powered False 09:39:51.840749 run create_hlr_db(pid=983): Terminated: ok {rc=0} 09:39:52.285215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=985): Launched 09:39:52.602181 run osmo-hlr_10.42.42.2(pid=986): Launched 09:39:52.722386 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:53.269228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=989): Launched 09:39:53.586583 run osmo-stp_10.42.42.5(pid=990): Launched 09:39:53.707716 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:54.284231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=996): Launched 09:39:54.601944 run osmo-msc_10.42.42.6(pid=997): Launched 09:39:54.779296 run osmo-stp_10.42.42.5(pid=990): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=990)] 09:39:54.913223 run osmo-stp_10.42.42.5(pid=990): stdout: | (launched: 2022-12-13_09:39:53.528763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:55.047674 run osmo-stp_10.42.42.5(pid=990): stderr: | 20221213093953721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093953721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093953721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093953722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093953722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093953722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093953722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:55.182086 run osmo-stp_10.42.42.5(pid=990): stdout: | (launched: 2022-12-13_09:39:53.528763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:55.309033 run osmo-stp_10.42.42.5(pid=990): stderr: | 20221213093953721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213093953721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213093953721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213093953722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213093953722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213093953722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213093953722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:55.460567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=990): Process ended prematurely: osmo-stp_10.42.42.5(pid=990) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=990)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:39:55.470117 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:39:55.497566 run osmo-hlr_10.42.42.2(pid=986): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=986)] 09:39:55.546987 run osmo-hlr_10.42.42.2(pid=986): stdout: | (launched: 2022-12-13_09:39:52.544415) 09:39:55.598308 run osmo-hlr_10.42.42.2(pid=986): stderr: | 20221213093952744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213093952744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213093952744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213093952744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213093952744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213093952745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213093952757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213093952767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213093952767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213093952767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:55.669890 run osmo-msc_10.42.42.6(pid=997): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=997)] 09:39:55.719200 run osmo-msc_10.42.42.6(pid=997): stdout: | (launched: 2022-12-13_09:39:54.543962) 09:39:55.770547 run osmo-msc_10.42.42.6(pid=997): stderr: | 20221213093954866 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213093954866 DLGLOBAL DEBUG validating counter group 0x7f956922fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213093954867 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213093954867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213093954867 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213093954867 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213093954869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213093954869 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213093954869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213093954870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:55.821808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=985): Terminating (SIGTERM) 09:39:55.862930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=989): Terminating (SIGTERM) 09:39:55.904046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=996): Terminating (SIGTERM) 09:39:55.945732 --- ParallelTerminationStrategy: PID 985 died... 09:39:55.965573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=985): Terminated: ok {rc=0} 09:39:56.011373 --- ParallelTerminationStrategy: PID 989 died... 09:39:56.030818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=989): Terminated: ok {rc=0} 09:39:56.076578 --- ParallelTerminationStrategy: PID 996 died... 09:39:56.096115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=996): Terminated: ok {rc=0} 09:39:56.182720 bus /sierra_3: Setting Powered False 09:39:57.279829 bus /sierra_3: Setting Powered False 09:39:58.394075 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:39:59.644185 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:59.652047 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:39:59.684668 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:39:59.712029 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:39:59.766559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:39:59.799559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:39:59.826221 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:40:00.378215 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:40:00.429448 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:00.441312 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:40:00.508914 tst mo_mt_call.py: using LAC 33091 09:40:00.633829 tst mo_mt_call.py: using RAC 196 09:40:00.758875 tst mo_mt_call.py: using CellId 33091 09:40:00.899297 tst mo_mt_call.py: using BVCI 33092 09:40:01.023449 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:01.035680 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:01.048298 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:01.060684 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:01.073331 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:01.085414 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:40:01.228904 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:40:01.360556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:01.868325 run create_hlr_db(pid=1006): Launched 09:40:02.032653 bus /sierra_2: Setting Powered False 09:40:03.096593 run create_hlr_db(pid=1006): Terminated: ok {rc=0} 09:40:03.538712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1008): Launched 09:40:03.855877 run osmo-hlr_10.42.42.2(pid=1009): Launched 09:40:03.977122 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:04.529234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1011): Launched 09:40:04.846476 run osmo-stp_10.42.42.5(pid=1012): Launched 09:40:04.967655 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:05.542450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1014): Launched 09:40:05.860639 run osmo-msc_10.42.42.6(pid=1015): Launched 09:40:06.038266 run osmo-stp_10.42.42.5(pid=1012): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1012)] 09:40:06.173102 run osmo-stp_10.42.42.5(pid=1012): stdout: | (launched: 2022-12-13_09:40:04.788659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:06.312351 run osmo-stp_10.42.42.5(pid=1012): stderr: | 20221213094004980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094004980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094004980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094004981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094004983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094004983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094004983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:06.446766 run osmo-stp_10.42.42.5(pid=1012): stdout: | (launched: 2022-12-13_09:40:04.788659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:06.573285 run osmo-stp_10.42.42.5(pid=1012): stderr: | 20221213094004980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094004980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094004980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094004981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094004983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094004983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094004983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:06.724806 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1012): Process ended prematurely: osmo-stp_10.42.42.5(pid=1012) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1012)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:40:06.734275 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:40:06.762037 run osmo-hlr_10.42.42.2(pid=1009): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1009)] 09:40:06.811670 run osmo-hlr_10.42.42.2(pid=1009): stdout: | (launched: 2022-12-13_09:40:03.798400) 09:40:06.863262 run osmo-hlr_10.42.42.2(pid=1009): stderr: | 20221213094003999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094003999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094003999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094003999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094003999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094003999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094004012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094004020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094004020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094004020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:06.935067 run osmo-msc_10.42.42.6(pid=1015): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1015)] 09:40:06.984567 run osmo-msc_10.42.42.6(pid=1015): stdout: | (launched: 2022-12-13_09:40:05.802460) 09:40:07.035924 run osmo-msc_10.42.42.6(pid=1015): stderr: | 20221213094006144 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094006144 DLGLOBAL DEBUG validating counter group 0x7f834c5d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094006144 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094006144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094006144 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094006145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094006146 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094006147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094006147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094006147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:07.087582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1008): Terminating (SIGTERM) 09:40:07.129198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1011): Terminating (SIGTERM) 09:40:07.170634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1014): Terminating (SIGTERM) 09:40:07.212161 --- ParallelTerminationStrategy: PID 1008 died... 09:40:07.232062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1008): Terminated: ok {rc=0} 09:40:07.278258 --- ParallelTerminationStrategy: PID 1011 died... 09:40:07.297569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1011): Terminated: ok {rc=0} 09:40:07.343188 --- ParallelTerminationStrategy: PID 1014 died... 09:40:07.362538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1014): Terminated: ok {rc=0} 09:40:07.448082 bus /sierra_3: Setting Powered False 09:40:08.547411 bus /sierra_3: Setting Powered False 09:40:09.661963 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:40:10.808617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:10.820708 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:40:10.888796 tst mo_mt_call_osmux.py: using LAC 33092 09:40:11.013336 tst mo_mt_call_osmux.py: using RAC 197 09:40:11.138562 tst mo_mt_call_osmux.py: using CellId 33092 09:40:11.265041 tst mo_mt_call_osmux.py: using BVCI 33093 09:40:11.380453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:11.392072 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:11.403426 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:11.414774 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:11.426267 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:40:11.437945 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:40:11.554933 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:40:11.673612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:12.135499 run create_hlr_db(pid=1017): Launched 09:40:12.251472 bus /sierra_2: Setting Powered False 09:40:13.312084 run create_hlr_db(pid=1017): Terminated: ok {rc=0} 09:40:13.747672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1019): Launched 09:40:14.066458 run osmo-hlr_10.42.42.2(pid=1020): Launched 09:40:14.189670 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:14.737238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1022): Launched 09:40:15.054807 run osmo-stp_10.42.42.5(pid=1023): Launched 09:40:15.177160 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:15.752822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1025): Launched 09:40:16.096675 run osmo-msc_10.42.42.6(pid=1026): Launched 09:40:16.459146 run osmo-stp_10.42.42.5(pid=1023): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1023)] 09:40:16.663721 run osmo-stp_10.42.42.5(pid=1023): stdout: | (launched: 2022-12-13_09:40:14.997108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:16.838510 run osmo-stp_10.42.42.5(pid=1023): stderr: | 20221213094015190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094015190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094015190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094015190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094015191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094015191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094015191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:17.027132 run osmo-stp_10.42.42.5(pid=1023): stdout: | (launched: 2022-12-13_09:40:14.997108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:17.160403 run osmo-stp_10.42.42.5(pid=1023): stderr: | 20221213094015190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094015190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094015190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094015190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094015191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094015191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094015191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:17.316292 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1023): Process ended prematurely: osmo-stp_10.42.42.5(pid=1023) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1023)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:40:17.326489 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:40:17.354922 run osmo-hlr_10.42.42.2(pid=1020): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1020)] 09:40:17.405179 run osmo-hlr_10.42.42.2(pid=1020): stdout: | (launched: 2022-12-13_09:40:14.008555) 09:40:17.457179 run osmo-hlr_10.42.42.2(pid=1020): stderr: | 20221213094014207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094014207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094014207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094014207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094014207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094014207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094014224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094014234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094014234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094014234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:17.529213 run osmo-msc_10.42.42.6(pid=1026): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1026)] 09:40:17.578664 run osmo-msc_10.42.42.6(pid=1026): stdout: | (launched: 2022-12-13_09:40:16.030094) 09:40:17.629756 run osmo-msc_10.42.42.6(pid=1026): stderr: | 20221213094016530 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094016531 DLGLOBAL DEBUG validating counter group 0x7f0761988c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094016531 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094016531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094016531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094016531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094016547 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094016547 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094016548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094016548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:17.681237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1019): Terminating (SIGTERM) 09:40:17.722700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1022): Terminating (SIGTERM) 09:40:17.764066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1025): Terminating (SIGTERM) 09:40:17.805679 --- ParallelTerminationStrategy: PID 1019 died... 09:40:17.825430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1019): Terminated: ok {rc=0} 09:40:17.871446 --- ParallelTerminationStrategy: PID 1022 died... 09:40:17.890905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1022): Terminated: ok {rc=0} 09:40:17.936517 --- ParallelTerminationStrategy: PID 1025 died... 09:40:17.955984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1025): Terminated: ok {rc=0} 09:40:18.042320 bus /sierra_3: Setting Powered False 09:40:19.139800 bus /sierra_3: Setting Powered False 09:40:20.253996 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:40:21.501412 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:21.508393 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:40:21.539677 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:40:21.568226 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:40:21.618113 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:40:21.649343 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:40:21.676098 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:40:22.233922 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:40:22.284695 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:22.295882 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:40:22.361520 tst mo_mt_call.py: using LAC 33093 09:40:22.479722 tst mo_mt_call.py: using RAC 198 09:40:22.594324 tst mo_mt_call.py: using CellId 33093 09:40:22.709975 tst mo_mt_call.py: using BVCI 33094 09:40:22.817385 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:22.828730 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:22.839666 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:22.850571 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:22.861871 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:22.873105 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:40:22.986207 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:40:23.105606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:23.599362 run create_hlr_db(pid=1031): Launched 09:40:23.728785 bus /sierra_2: Setting Powered False 09:40:24.792037 run create_hlr_db(pid=1031): Terminated: ok {rc=0} 09:40:25.235035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1033): Launched 09:40:25.551798 run osmo-hlr_10.42.42.2(pid=1034): Launched 09:40:25.672861 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:26.220016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1036): Launched 09:40:26.538971 run osmo-stp_10.42.42.5(pid=1037): Launched 09:40:26.660529 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:27.237028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1039): Launched 09:40:27.554457 run osmo-msc_10.42.42.6(pid=1040): Launched 09:40:27.733471 run osmo-stp_10.42.42.5(pid=1037): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1037)] 09:40:27.866881 run osmo-stp_10.42.42.5(pid=1037): stdout: | (launched: 2022-12-13_09:40:26.481127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:28.001101 run osmo-stp_10.42.42.5(pid=1037): stderr: | 20221213094026672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094026672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094026673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094026673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094026674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094026674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094026674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:28.135039 run osmo-stp_10.42.42.5(pid=1037): stdout: | (launched: 2022-12-13_09:40:26.481127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:28.261987 run osmo-stp_10.42.42.5(pid=1037): stderr: | 20221213094026672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094026672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094026673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094026673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094026674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094026674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094026674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:28.413975 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1037): Process ended prematurely: osmo-stp_10.42.42.5(pid=1037) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1037)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:40:28.423361 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:40:28.450876 run osmo-hlr_10.42.42.2(pid=1034): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1034)] 09:40:28.500229 run osmo-hlr_10.42.42.2(pid=1034): stdout: | (launched: 2022-12-13_09:40:25.494109) 09:40:28.551249 run osmo-hlr_10.42.42.2(pid=1034): stderr: | 20221213094025692 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094025692 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094025692 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094025692 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094025692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094025692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094025707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094025715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094025715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094025715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:28.622624 run osmo-msc_10.42.42.6(pid=1040): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1040)] 09:40:28.671774 run osmo-msc_10.42.42.6(pid=1040): stdout: | (launched: 2022-12-13_09:40:27.496517) 09:40:28.722736 run osmo-msc_10.42.42.6(pid=1040): stderr: | 20221213094027819 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094027819 DLGLOBAL DEBUG validating counter group 0x7f938d168c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094027819 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094027819 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094027819 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094027819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094027821 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094027822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094027822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094027822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:28.774072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1033): Terminating (SIGTERM) 09:40:28.815240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1036): Terminating (SIGTERM) 09:40:28.856477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1039): Terminating (SIGTERM) 09:40:28.898230 --- ParallelTerminationStrategy: PID 1033 died... 09:40:28.918353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1033): Terminated: ok {rc=0} 09:40:28.964097 --- ParallelTerminationStrategy: PID 1036 died... 09:40:28.983514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1036): Terminated: ok {rc=0} 09:40:29.029171 --- ParallelTerminationStrategy: PID 1039 died... 09:40:29.048536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1039): Terminated: ok {rc=0} 09:40:29.135317 bus /sierra_3: Setting Powered False 09:40:30.231862 bus /sierra_3: Setting Powered False 09:40:31.343907 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:40:32.488031 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:32.499674 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:40:32.566893 tst mo_mt_call_osmux.py: using LAC 33094 09:40:32.692852 tst mo_mt_call_osmux.py: using RAC 199 09:40:32.817841 tst mo_mt_call_osmux.py: using CellId 33094 09:40:32.942658 tst mo_mt_call_osmux.py: using BVCI 33095 09:40:33.058628 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:33.070302 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:33.081730 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:33.093120 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:33.104513 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:40:33.115908 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:40:33.232159 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:40:33.352214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:33.845668 run create_hlr_db(pid=1042): Launched 09:40:33.974526 bus /sierra_2: Setting Powered False 09:40:35.037527 run create_hlr_db(pid=1042): Terminated: ok {rc=0} 09:40:35.463400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1044): Launched 09:40:35.761418 run osmo-hlr_10.42.42.2(pid=1045): Launched 09:40:35.875141 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:36.391480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1047): Launched 09:40:36.689343 run osmo-stp_10.42.42.5(pid=1048): Launched 09:40:36.802787 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:37.342403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1050): Launched 09:40:37.639773 run osmo-msc_10.42.42.6(pid=1051): Launched 09:40:37.808743 run osmo-stp_10.42.42.5(pid=1048): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1048)] 09:40:37.937296 run osmo-stp_10.42.42.5(pid=1048): stdout: | (launched: 2022-12-13_09:40:36.634597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:38.063827 run osmo-stp_10.42.42.5(pid=1048): stderr: | 20221213094036806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094036807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094036807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094036807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094036808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094036808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094036808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:38.188068 run osmo-stp_10.42.42.5(pid=1048): stdout: | (launched: 2022-12-13_09:40:36.634597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:38.306805 run osmo-stp_10.42.42.5(pid=1048): stderr: | 20221213094036806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094036807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094036807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094036807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094036808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094036808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094036808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:38.449745 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1048): Process ended prematurely: osmo-stp_10.42.42.5(pid=1048) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1048)] [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:40:38.458776 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:40:38.484889 run osmo-hlr_10.42.42.2(pid=1045): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1045)] 09:40:38.532831 run osmo-hlr_10.42.42.2(pid=1045): stdout: | (launched: 2022-12-13_09:40:35.706798) 09:40:38.581587 run osmo-hlr_10.42.42.2(pid=1045): stderr: | 20221213094035885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094035885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094035885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094035885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094035885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094035885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094035897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094035905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094035906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094035906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:38.650054 run osmo-msc_10.42.42.6(pid=1051): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1051)] 09:40:38.696717 run osmo-msc_10.42.42.6(pid=1051): stdout: | (launched: 2022-12-13_09:40:37.585155) 09:40:38.745431 run osmo-msc_10.42.42.6(pid=1051): stderr: | 20221213094037854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094037855 DLGLOBAL DEBUG validating counter group 0x7fae7aaacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094037855 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094037855 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094037855 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094037855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094037858 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094037859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094037859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094037859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:38.794501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1044): Terminating (SIGTERM) 09:40:38.833837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1047): Terminating (SIGTERM) 09:40:38.873244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1050): Terminating (SIGTERM) 09:40:38.912848 --- ParallelTerminationStrategy: PID 1044 died... 09:40:38.932286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1044): Terminated: ok {rc=0} 09:40:38.975897 --- ParallelTerminationStrategy: PID 1047 died... 09:40:38.994757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1047): Terminated: ok {rc=0} 09:40:39.038136 --- ParallelTerminationStrategy: PID 1050 died... 09:40:39.056897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1050): Terminated: ok {rc=0} 09:40:39.142979 bus /sierra_3: Setting Powered False 09:40:40.240180 bus /sierra_3: Setting Powered False 09:40:41.353736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:40:42.605322 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:42.613550 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:40:42.646027 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:40:42.673504 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:40:42.730156 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:40:42.763422 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:40:42.790575 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:40:43.335864 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:40:43.384558 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:43.395935 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:40:43.460370 tst mo_mt_call.py: using LAC 33095 09:40:43.576064 tst mo_mt_call.py: using RAC 200 09:40:43.692064 tst mo_mt_call.py: using CellId 33095 09:40:43.807930 tst mo_mt_call.py: using BVCI 33096 09:40:43.915949 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:43.927288 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:43.938437 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:43.949630 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:43.961227 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:43.972799 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:40:44.092719 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:40:44.215709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:44.709205 run create_hlr_db(pid=1056): Launched 09:40:44.830946 bus /sierra_2: Setting Powered False 09:40:45.914226 run create_hlr_db(pid=1056): Terminated: ok {rc=0} 09:40:46.374007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1058): Launched 09:40:46.714254 run osmo-hlr_10.42.42.2(pid=1059): Launched 09:40:46.960497 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:47.586523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1061): Launched 09:40:47.903915 run osmo-stp_10.42.42.5(pid=1062): Launched 09:40:48.025759 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:48.601905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1064): Launched 09:40:48.918377 run osmo-msc_10.42.42.6(pid=1065): Launched 09:40:49.095486 run osmo-stp_10.42.42.5(pid=1062): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1062)] 09:40:49.230001 run osmo-stp_10.42.42.5(pid=1062): stdout: | (launched: 2022-12-13_09:40:47.846199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:49.364064 run osmo-stp_10.42.42.5(pid=1062): stderr: | 20221213094048040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094048041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094048041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094048041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094048042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094048042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094048042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:49.497881 run osmo-stp_10.42.42.5(pid=1062): stdout: | (launched: 2022-12-13_09:40:47.846199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:49.624500 run osmo-stp_10.42.42.5(pid=1062): stderr: | 20221213094048040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094048041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094048041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094048041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094048042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094048042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094048042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:49.776563 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1062): Process ended prematurely: osmo-stp_10.42.42.5(pid=1062) [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1062)] [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:40:49.786018 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:40:49.813330 run osmo-hlr_10.42.42.2(pid=1059): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1059)] 09:40:49.862738 run osmo-hlr_10.42.42.2(pid=1059): stdout: | (launched: 2022-12-13_09:40:46.647192) 09:40:49.913845 run osmo-hlr_10.42.42.2(pid=1059): stderr: | 20221213094046946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094046946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094046946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094046946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094046946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094046946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094046966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094046978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094046978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094046979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:49.985217 run osmo-msc_10.42.42.6(pid=1065): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1065)] 09:40:50.034332 run osmo-msc_10.42.42.6(pid=1065): stdout: | (launched: 2022-12-13_09:40:48.860603) 09:40:50.085338 run osmo-msc_10.42.42.6(pid=1065): stderr: | 20221213094049181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094049181 DLGLOBAL DEBUG validating counter group 0x7f2bf94f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094049181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094049181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094049181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094049182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094049183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094049184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094049184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094049184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:50.136611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1058): Terminating (SIGTERM) 09:40:50.178185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1061): Terminating (SIGTERM) 09:40:50.219583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1064): Terminating (SIGTERM) 09:40:50.261157 --- ParallelTerminationStrategy: PID 1058 died... 09:40:50.280822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1058): Terminated: ok {rc=0} 09:40:50.326570 --- ParallelTerminationStrategy: PID 1061 died... 09:40:50.345903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1061): Terminated: ok {rc=0} 09:40:50.391000 --- ParallelTerminationStrategy: PID 1064 died... 09:40:50.410301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1064): Terminated: ok {rc=0} 09:40:50.496402 bus /sierra_3: Setting Powered False 09:40:51.593424 bus /sierra_3: Setting Powered False 09:40:52.707223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:40:53.853832 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:53.866110 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:40:53.934594 tst mo_mt_call_osmux.py: using LAC 33096 09:40:54.061156 tst mo_mt_call_osmux.py: using RAC 201 09:40:54.186339 tst mo_mt_call_osmux.py: using CellId 33096 09:40:54.312593 tst mo_mt_call_osmux.py: using BVCI 33097 09:40:54.428029 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:54.439706 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:54.451132 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:54.462559 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:54.474132 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:40:54.485663 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:40:54.606625 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:40:54.723595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:55.187358 run create_hlr_db(pid=1067): Launched 09:40:55.302725 bus /sierra_2: Setting Powered False 09:40:56.366718 run create_hlr_db(pid=1067): Terminated: ok {rc=0} 09:40:56.811494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1069): Launched 09:40:57.129733 run osmo-hlr_10.42.42.2(pid=1070): Launched 09:40:57.251168 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:57.802738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1072): Launched 09:40:58.120702 run osmo-stp_10.42.42.5(pid=1073): Launched 09:40:58.242615 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:58.818506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1075): Launched 09:40:59.136732 run osmo-msc_10.42.42.6(pid=1076): Launched 09:40:59.315283 run osmo-stp_10.42.42.5(pid=1073): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1073)] 09:40:59.450487 run osmo-stp_10.42.42.5(pid=1073): stdout: | (launched: 2022-12-13_09:40:58.062849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:59.585849 run osmo-stp_10.42.42.5(pid=1073): stderr: | 20221213094058254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094058255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094058255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094058255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094058256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094058256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094058256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:59.719946 run osmo-stp_10.42.42.5(pid=1073): stdout: | (launched: 2022-12-13_09:40:58.062849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:59.847106 run osmo-stp_10.42.42.5(pid=1073): stderr: | 20221213094058254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094058255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094058255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094058255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094058256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094058256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094058256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:59.999204 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1073): Process ended prematurely: osmo-stp_10.42.42.5(pid=1073) [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1073)] [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:41:00.008656 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:41:00.036565 run osmo-hlr_10.42.42.2(pid=1070): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1070)] 09:41:00.086990 run osmo-hlr_10.42.42.2(pid=1070): stdout: | (launched: 2022-12-13_09:40:57.071939) 09:41:00.139050 run osmo-hlr_10.42.42.2(pid=1070): stderr: | 20221213094057269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094057269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094057269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094057269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094057269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094057269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094057281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094057289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094057290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094057290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:00.212173 run osmo-msc_10.42.42.6(pid=1076): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1076)] 09:41:00.262057 run osmo-msc_10.42.42.6(pid=1076): stdout: | (launched: 2022-12-13_09:40:59.078590) 09:41:00.313719 run osmo-msc_10.42.42.6(pid=1076): stderr: | 20221213094059403 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094059403 DLGLOBAL DEBUG validating counter group 0x7fd164ce6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094059403 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094059403 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094059403 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094059403 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094059405 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094059406 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094059406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094059406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:00.365530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1069): Terminating (SIGTERM) 09:41:00.407171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1072): Terminating (SIGTERM) 09:41:00.448902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1075): Terminating (SIGTERM) 09:41:00.490955 --- ParallelTerminationStrategy: PID 1069 died... 09:41:00.510476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1069): Terminated: ok {rc=0} 09:41:00.557083 --- ParallelTerminationStrategy: PID 1072 died... 09:41:00.576846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1072): Terminated: ok {rc=0} 09:41:00.623363 --- ParallelTerminationStrategy: PID 1075 died... 09:41:00.643043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1075): Terminated: ok {rc=0} 09:41:00.730000 bus /sierra_3: Setting Powered False 09:41:01.833551 bus /sierra_3: Setting Powered False 09:41:02.959553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:41:04.203415 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:04.210242 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:41:04.241679 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 09:41:04.269200 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 09:41:04.320284 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:41:04.352317 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 09:41:04.379151 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 09:41:04.931075 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 09:41:04.979738 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:04.991224 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:41:05.039604 tst mo_mt_call.py: using LAC 33097 09:41:05.157191 tst mo_mt_call.py: using RAC 202 09:41:05.282746 tst mo_mt_call.py: using CellId 33097 09:41:05.407418 tst mo_mt_call.py: using BVCI 33098 09:41:05.524676 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:05.536615 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:05.548361 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:05.559961 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:05.571695 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:05.583317 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:41:05.699787 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:41:05.815749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:06.277284 run create_hlr_db(pid=1081): Launched 09:41:06.392082 bus /sierra_2: Setting Powered False 09:41:07.452731 run create_hlr_db(pid=1081): Terminated: ok {rc=0} 09:41:07.879142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1083): Launched 09:41:08.177480 run osmo-hlr_10.42.42.2(pid=1084): Launched 09:41:08.292129 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:08.809498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1086): Launched 09:41:09.107260 run osmo-stp_10.42.42.5(pid=1087): Launched 09:41:09.221325 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:09.758356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1089): Launched 09:41:10.055914 run osmo-msc_10.42.42.6(pid=1090): Launched 09:41:10.222785 run osmo-stp_10.42.42.5(pid=1087): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1087)] 09:41:10.350673 run osmo-stp_10.42.42.5(pid=1087): stdout: | (launched: 2022-12-13_09:41:09.052652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:10.476645 run osmo-stp_10.42.42.5(pid=1087): stderr: | 20221213094109225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094109225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094109225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094109225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094109226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094109226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094109226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:10.600623 run osmo-stp_10.42.42.5(pid=1087): stdout: | (launched: 2022-12-13_09:41:09.052652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:10.719559 run osmo-stp_10.42.42.5(pid=1087): stderr: | 20221213094109225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094109225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094109225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094109225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094109226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094109226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094109226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:10.862705 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1087): Process ended prematurely: osmo-stp_10.42.42.5(pid=1087) [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1087)] [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 09:41:10.871586 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:41:10.897508 run osmo-hlr_10.42.42.2(pid=1084): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1084)] 09:41:10.945057 run osmo-hlr_10.42.42.2(pid=1084): stdout: | (launched: 2022-12-13_09:41:08.122686) 09:41:10.993991 run osmo-hlr_10.42.42.2(pid=1084): stderr: | 20221213094108295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094108295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094108295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094108295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094108295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094108296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094108307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094108316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094108316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094108316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:11.062503 run osmo-msc_10.42.42.6(pid=1090): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1090)] 09:41:11.109481 run osmo-msc_10.42.42.6(pid=1090): stdout: | (launched: 2022-12-13_09:41:10.001639) 09:41:11.158196 run osmo-msc_10.42.42.6(pid=1090): stderr: | 20221213094110274 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094110274 DLGLOBAL DEBUG validating counter group 0x7f1951ee4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094110274 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094110274 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094110275 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094110275 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094110276 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094110277 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094110277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094110277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:11.207598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1083): Terminating (SIGTERM) 09:41:11.247179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1086): Terminating (SIGTERM) 09:41:11.286803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1089): Terminating (SIGTERM) 09:41:11.326763 --- ParallelTerminationStrategy: PID 1083 died... 09:41:11.346284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1083): Terminated: ok {rc=0} 09:41:11.390270 --- ParallelTerminationStrategy: PID 1086 died... 09:41:11.408876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1086): Terminated: ok {rc=0} 09:41:11.453057 --- ParallelTerminationStrategy: PID 1089 died... 09:41:11.471909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1089): Terminated: ok {rc=0} 09:41:11.558094 bus /sierra_3: Setting Powered False 09:41:12.656236 bus /sierra_3: Setting Powered False 09:41:13.770334 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 09:41:14.914345 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:14.926253 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:41:14.975068 tst mo_mt_call_osmux.py: using LAC 33098 09:41:15.093916 tst mo_mt_call_osmux.py: using RAC 203 09:41:15.212888 tst mo_mt_call_osmux.py: using CellId 33098 09:41:15.329892 tst mo_mt_call_osmux.py: using BVCI 33099 09:41:15.438456 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:15.449991 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:15.461213 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:15.472352 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:15.484378 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:41:15.496393 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:41:15.613780 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:41:15.730866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:16.260750 run create_hlr_db(pid=1092): Launched 09:41:16.422832 bus /sierra_2: Setting Powered False 09:41:17.486513 run create_hlr_db(pid=1092): Terminated: ok {rc=0} 09:41:17.930727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1094): Launched 09:41:18.250810 run osmo-hlr_10.42.42.2(pid=1095): Launched 09:41:18.371814 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:18.925103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1097): Launched 09:41:19.244518 run osmo-stp_10.42.42.5(pid=1098): Launched 09:41:19.366566 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:19.942577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1100): Launched 09:41:20.262775 run osmo-msc_10.42.42.6(pid=1101): Launched 09:41:20.441423 run osmo-stp_10.42.42.5(pid=1098): ERR: Terminated: ERROR {rc=1} [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1098)] 09:41:20.575245 run osmo-stp_10.42.42.5(pid=1098): stdout: | (launched: 2022-12-13_09:41:19.186162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:20.710417 run osmo-stp_10.42.42.5(pid=1098): stderr: | 20221213094119379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094119379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094119379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094119380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094119380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094119380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094119380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:20.846054 run osmo-stp_10.42.42.5(pid=1098): stdout: | (launched: 2022-12-13_09:41:19.186162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:20.973293 run osmo-stp_10.42.42.5(pid=1098): stderr: | 20221213094119379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094119379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094119379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094119380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094119380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094119380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094119380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:21.125896 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1098): Process ended prematurely: osmo-stp_10.42.42.5(pid=1098) [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1098)] [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 09:41:21.135629 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:41:21.163556 run osmo-hlr_10.42.42.2(pid=1095): ERR: Terminated: ERROR {rc=237} [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1095)] 09:41:21.213255 run osmo-hlr_10.42.42.2(pid=1095): stdout: | (launched: 2022-12-13_09:41:18.192368) 09:41:21.264597 run osmo-hlr_10.42.42.2(pid=1095): stderr: | 20221213094118390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094118390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094118390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094118390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094118390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094118390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094118402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094118410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094118411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094118411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:21.336255 run osmo-msc_10.42.42.6(pid=1101): ERR: Terminated: ERROR {rc=2} [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1101)] 09:41:21.385511 run osmo-msc_10.42.42.6(pid=1101): stdout: | (launched: 2022-12-13_09:41:20.204450) 09:41:21.436306 run osmo-msc_10.42.42.6(pid=1101): stderr: | 20221213094120526 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094120526 DLGLOBAL DEBUG validating counter group 0x7f77f594cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094120526 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094120526 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094120527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094120527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094120529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094120529 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094120529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094120529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:21.487709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1094): Terminating (SIGTERM) 09:41:21.528934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1097): Terminating (SIGTERM) 09:41:21.570550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1100): Terminating (SIGTERM) 09:41:21.612889 --- ParallelTerminationStrategy: PID 1094 died... 09:41:21.633267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1094): Terminated: ok {rc=0} 09:41:21.679325 --- ParallelTerminationStrategy: PID 1097 died... 09:41:21.699094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1097): Terminated: ok {rc=0} 09:41:21.745235 --- ParallelTerminationStrategy: PID 1100 died... 09:41:21.764463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1100): Terminated: ok {rc=0} 09:41:21.851783 bus /sierra_3: Setting Powered False 09:41:22.950653 bus /sierra_3: Setting Powered False 09:41:24.065587 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 emergency:nanobts+band-900 --------------------------------------------------------------------- 09:41:25.317718 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:25.322865 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:41:25.354069 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:41:25.381045 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:41:25.463675 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:41:25.494947 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:41:25.521109 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:41:26.104850 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2387 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 09:41:26.109725 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:26.120424 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:41:26.167196 tst emergency_mo_mt_call.py: using LAC 33099 09:41:26.281363 tst emergency_mo_mt_call.py: using RAC 204 09:41:26.396763 tst emergency_mo_mt_call.py: using CellId 33099 09:41:26.510684 tst emergency_mo_mt_call.py: using BVCI 33100 09:41:26.616510 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:26.627284 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:26.637832 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:26.648185 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:26.658596 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:26.669418 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:26.784385 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:26.902305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:27.390451 run create_hlr_db(pid=1106): Launched 09:41:27.518088 bus /sierra_2: Setting Powered False 09:41:28.579913 run create_hlr_db(pid=1106): Terminated: ok {rc=0} 09:41:28.998467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1108): Launched 09:41:29.291587 run osmo-hlr_10.42.42.2(pid=1109): Launched 09:41:29.403111 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:29.943981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1111): Launched 09:41:30.257422 run osmo-stp_10.42.42.5(pid=1112): Launched 09:41:30.386213 tst emergency_mo_mt_call.py: using MSISDN 8086 09:41:30.545994 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:31.119050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1115): Launched 09:41:31.437721 run osmo-msc_10.42.42.6(pid=1116): Launched 09:41:31.711895 run osmo-stp_10.42.42.5(pid=1112): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1112)] 09:41:31.918070 run osmo-stp_10.42.42.5(pid=1112): stdout: | (launched: 2022-12-13_09:41:30.200057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:32.198536 run osmo-stp_10.42.42.5(pid=1112): stderr: | 20221213094130393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094130393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094130393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094130393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094130394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094130394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094130394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:32.498543 run osmo-stp_10.42.42.5(pid=1112): stdout: | (launched: 2022-12-13_09:41:30.200057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:32.619785 run osmo-stp_10.42.42.5(pid=1112): stderr: | 20221213094130393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094130393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094130393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094130393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094130394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094130394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094130394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:32.759693 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1112): Process ended prematurely: osmo-stp_10.42.42.5(pid=1112) [trial-2387↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1112)] [trial-2387↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 09:41:32.768208 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 09:41:32.794629 run osmo-hlr_10.42.42.2(pid=1109): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1109)] 09:41:32.843097 run osmo-hlr_10.42.42.2(pid=1109): stdout: | (launched: 2022-12-13_09:41:29.238252) 09:41:32.892793 run osmo-hlr_10.42.42.2(pid=1109): stderr: | 20221213094129411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094129411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094129411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094129411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094129411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094129411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094129423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094129432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094129432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094129432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:32.962452 run osmo-msc_10.42.42.6(pid=1116): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1116)] 09:41:33.009783 run osmo-msc_10.42.42.6(pid=1116): stdout: | (launched: 2022-12-13_09:41:31.375571) 09:41:33.059254 run osmo-msc_10.42.42.6(pid=1116): stderr: | 20221213094131993 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094131993 DLGLOBAL DEBUG validating counter group 0x7fa4c0f1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094131993 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094131993 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094131993 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094131994 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094131995 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094131996 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094131996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094131996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:33.108892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1108): Terminating (SIGTERM) 09:41:33.148564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1111): Terminating (SIGTERM) 09:41:33.188308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1115): Terminating (SIGTERM) 09:41:33.228434 --- ParallelTerminationStrategy: PID 1108 died... 09:41:33.247558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1108): Terminated: ok {rc=0} 09:41:33.292022 --- ParallelTerminationStrategy: PID 1111 died... 09:41:33.311155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1111): Terminated: ok {rc=0} 09:41:33.355440 --- ParallelTerminationStrategy: PID 1115 died... 09:41:33.374705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1115): Terminated: ok {rc=0} 09:41:33.462016 bus /sierra_3: Setting Powered False 09:41:34.560555 bus /sierra_3: Setting Powered False 09:41:35.675213 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 09:41:36.761993 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:36.774447 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:41:36.823378 tst emergency_preemptive_call.py: using LAC 33100 09:41:36.947588 tst emergency_preemptive_call.py: using RAC 205 09:41:37.071837 tst emergency_preemptive_call.py: using CellId 33100 09:41:37.194270 tst emergency_preemptive_call.py: using BVCI 33101 09:41:37.308175 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:37.319437 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:37.330529 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:37.341461 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:37.352397 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:41:37.363348 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:37.481186 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:37.599447 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:37.718087 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:37.833187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:38.290271 run create_hlr_db(pid=1118): Launched 09:41:38.403434 bus /sierra_2: Setting Powered False 09:41:39.462221 run create_hlr_db(pid=1118): Terminated: ok {rc=0} 09:41:39.891586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1121): Launched 09:41:40.191485 run osmo-hlr_10.42.42.2(pid=1122): Launched 09:41:40.304147 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:40.824522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1128): Launched 09:41:41.117661 run osmo-stp_10.42.42.5(pid=1129): Launched 09:41:41.240121 tst emergency_preemptive_call.py: using MSISDN 8087 09:41:41.401972 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:41.927878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1131): Launched 09:41:42.221123 run osmo-msc_10.42.42.6(pid=1132): Launched 09:41:42.385078 run osmo-stp_10.42.42.5(pid=1129): ERR: Terminated: ERROR {rc=1} [trial-2387↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1129)] 09:41:42.509619 run osmo-stp_10.42.42.5(pid=1129): stdout: | (launched: 2022-12-13_09:41:41.063950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:42.634202 run osmo-stp_10.42.42.5(pid=1129): stderr: | 20221213094141235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094141235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094141236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094141236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094141237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094141237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094141237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:42.756842 run osmo-stp_10.42.42.5(pid=1129): stdout: | (launched: 2022-12-13_09:41:41.063950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:42.874124 run osmo-stp_10.42.42.5(pid=1129): stderr: | 20221213094141235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094141235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094141236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094141236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094141237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094141237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094141237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:43.014995 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1129): Process ended prematurely: osmo-stp_10.42.42.5(pid=1129) [trial-2387↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1129)] [trial-2387↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 09:41:43.023583 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 09:41:43.049567 run osmo-hlr_10.42.42.2(pid=1122): ERR: Terminated: ERROR {rc=237} [trial-2387↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1122)] 09:41:43.097918 run osmo-hlr_10.42.42.2(pid=1122): stdout: | (launched: 2022-12-13_09:41:40.137485) 09:41:43.147638 run osmo-hlr_10.42.42.2(pid=1122): stderr: | 20221213094140310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094140310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094140310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094140310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094140310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094140310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094140326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094140336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094140336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094140336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:43.217323 run osmo-msc_10.42.42.6(pid=1132): ERR: Terminated: ERROR {rc=2} [trial-2387↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1132)] 09:41:43.264382 run osmo-msc_10.42.42.6(pid=1132): stdout: | (launched: 2022-12-13_09:41:42.166846) 09:41:43.314005 run osmo-msc_10.42.42.6(pid=1132): stderr: | 20221213094142439 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094142439 DLGLOBAL DEBUG validating counter group 0x7f580e624c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094142439 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094142439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094142439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094142440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094142441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094142442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094142442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094142442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:43.363843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1121): Terminating (SIGTERM) 09:41:43.403661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1128): Terminating (SIGTERM) 09:41:43.443433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1131): Terminating (SIGTERM) 09:41:43.483252 --- ParallelTerminationStrategy: PID 1121 died... 09:41:43.502829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1121): Terminated: ok {rc=0} 09:41:43.547062 --- ParallelTerminationStrategy: PID 1128 died... 09:41:43.566199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1128): Terminated: ok {rc=0} 09:41:43.610154 --- ParallelTerminationStrategy: PID 1131 died... 09:41:43.629201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1131): Terminated: ok {rc=0} 09:41:43.715018 bus /sierra_9: Setting Powered False 09:41:44.812205 bus /sierra_9: Setting Powered False 09:41:45.936769 bus /sierra_8: Setting Powered False 09:41:47.042530 bus /sierra_8: Setting Powered False 09:41:48.168062 bus /sierra_3: Setting Powered False 09:41:49.265524 bus /sierra_3: Setting Powered False 09:41:50.381046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900 --------------------------------------------------------------------- 09:41:51.660742 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:51.666261 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:41:51.699166 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 09:41:51.738415 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:41:51.826245 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:41:51.859043 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 09:41:51.898425 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:41:52.497231 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 09:41:52.550388 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:52.561502 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:41:52.618696 tst cs_paging_gprs_active.py: using LAC 33101 09:41:52.746269 tst cs_paging_gprs_active.py: using RAC 206 09:41:52.873456 tst cs_paging_gprs_active.py: using CellId 33101 09:41:52.998945 tst cs_paging_gprs_active.py: using BVCI 33102 09:41:53.117612 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.128656 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.139579 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.150508 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.161357 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.172638 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.183804 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.194756 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:41:53.205766 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:53.322702 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:41:53.445636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:41:53.661118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:41:53.981751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1142): Launched 09:41:54.260283 run iperf3-srv_10.42.42.10(pid=1144): Launched 09:41:54.380733 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:41:54.596121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:41:54.917195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1145): Launched 09:41:55.195225 run iperf3-srv_10.42.42.10(pid=1146): Launched 09:41:55.314962 tst cs_paging_gprs_active.py:38: start network... 09:41:55.530463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:56.025908 run create_hlr_db(pid=1147): Launched 09:41:56.156016 bus /sierra_2: Setting Powered False 09:41:57.220674 run create_hlr_db(pid=1147): Terminated: ok {rc=0} 09:41:57.664657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Launched 09:41:57.984473 run osmo-hlr_10.42.42.2(pid=1150): Launched 09:41:58.107267 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:58.657662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Launched 09:41:58.977806 run osmo-stp_10.42.42.5(pid=1153): Launched 09:41:59.100382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:41:59.652343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1155): Launched 09:41:59.774754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:42:00.045636 run patchelf(pid=1156): Launched 09:42:00.223472 run osmo-stp_10.42.42.5(pid=1153): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] 09:42:00.359004 run osmo-stp_10.42.42.5(pid=1153): stdout: | (launched: 2022-12-13_09:41:58.918682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:00.495904 run osmo-stp_10.42.42.5(pid=1153): stderr: | 20221213094159110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094159110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094159110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094159111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094159113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094159113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094159113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:00.632890 run osmo-stp_10.42.42.5(pid=1153): stdout: | (launched: 2022-12-13_09:41:58.918682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:00.764111 run osmo-stp_10.42.42.5(pid=1153): stderr: | 20221213094159110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094159110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094159110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094159111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094159113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094159113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094159113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:01.019282 run patchelf(pid=1156): Terminating (SIGINT) 09:42:01.266316 run patchelf(pid=1156): Terminated: ok {rc=0} 09:42:01.397524 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1153): Process ended prematurely: osmo-stp_10.42.42.5(pid=1153) [trial-2387↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] [trial-2387↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 09:42:01.408461 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 09:42:01.437597 run osmo-hlr_10.42.42.2(pid=1150): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1150)] 09:42:01.489864 run osmo-hlr_10.42.42.2(pid=1150): stdout: | (launched: 2022-12-13_09:41:57.926112) 09:42:01.542720 run osmo-hlr_10.42.42.2(pid=1150): stderr: | 20221213094158123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094158123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094158123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094158123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094158123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094158124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094158139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094158149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094158149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094158149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:01.598934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1142): Terminating (SIGTERM) 09:42:01.641421 run iperf3-srv_10.42.42.10(pid=1144): Terminating (SIGTERM) 09:42:01.687155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1145): Terminating (SIGTERM) 09:42:01.730357 run iperf3-srv_10.42.42.10(pid=1146): Terminating (SIGTERM) 09:42:01.777074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Terminating (SIGTERM) 09:42:01.820237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Terminating (SIGTERM) 09:42:01.865024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1155): Terminating (SIGTERM) 09:42:01.911896 --- ParallelTerminationStrategy: PID 1142 died... 09:42:01.933198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1142): Terminated: ok {rc=0} 09:42:01.982138 --- ParallelTerminationStrategy: PID 1144 died... 09:42:02.002461 run iperf3-srv_10.42.42.10(pid=1144): Terminated {rc=256} 09:42:02.048893 --- ParallelTerminationStrategy: PID 1145 died... 09:42:02.069939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1145): Terminated: ok {rc=0} 09:42:02.115895 --- ParallelTerminationStrategy: PID 1146 died... 09:42:02.137003 run iperf3-srv_10.42.42.10(pid=1146): Terminated {rc=256} 09:42:02.184183 --- ParallelTerminationStrategy: PID 1149 died... 09:42:02.204462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Terminated: ok {rc=0} 09:42:02.248785 --- ParallelTerminationStrategy: PID 1152 died... 09:42:02.268259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Terminated: ok {rc=0} 09:42:02.312624 --- ParallelTerminationStrategy: PID 1155 died... 09:42:02.332217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1155): Terminated: ok {rc=0} 09:42:02.418517 bus /gobi_0: Setting Powered False 09:42:03.517135 bus /gobi_0: Setting Powered False 09:42:04.627655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 09:42:05.774564 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:05.786281 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:42:05.836921 tst iperf3.py: using LAC 33102 09:42:05.956432 tst iperf3.py: using RAC 207 09:42:06.074600 tst iperf3.py: using CellId 33102 09:42:06.195670 tst iperf3.py: using BVCI 33103 09:42:06.307020 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.317955 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.328629 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.339287 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.350745 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.361940 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.373487 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.384663 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:06.396004 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:42:06.516750 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:42:06.732606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:42:07.052471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1167): Launched 09:42:07.330345 run iperf3-srv_10.42.42.10(pid=1168): Launched 09:42:07.450444 tst iperf3.py:8: start network... 09:42:07.666288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:08.161310 run create_hlr_db(pid=1169): Launched 09:42:08.292077 bus /gobi_6: Setting Powered False 09:42:09.355748 run create_hlr_db(pid=1169): Terminated: ok {rc=0} 09:42:09.783099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1171): Launched 09:42:10.081616 run osmo-hlr_10.42.42.2(pid=1172): Launched 09:42:10.195933 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:10.724691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1176): Launched 09:42:11.023609 run osmo-stp_10.42.42.5(pid=1177): Launched 09:42:11.137840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:42:11.652110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1179): Launched 09:42:11.766768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:42:12.019284 run patchelf(pid=1180): Launched 09:42:12.185712 run osmo-stp_10.42.42.5(pid=1177): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1177)] 09:42:12.312510 run osmo-stp_10.42.42.5(pid=1177): stdout: | (launched: 2022-12-13_09:42:10.968574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:12.441518 run osmo-stp_10.42.42.5(pid=1177): stderr: | 20221213094211140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094211140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094211140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094211141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094211141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094211141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094211141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:12.570749 run osmo-stp_10.42.42.5(pid=1177): stdout: | (launched: 2022-12-13_09:42:10.968574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:12.693860 run osmo-stp_10.42.42.5(pid=1177): stderr: | 20221213094211140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094211140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094211140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094211141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094211141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094211141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094211141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:12.839432 run patchelf(pid=1180): Terminating (SIGINT) 09:42:13.007274 run patchelf(pid=1180): Terminated: ok {rc=0} 09:42:13.128658 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1177): Process ended prematurely: osmo-stp_10.42.42.5(pid=1177) [trial-2387↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1177)] [trial-2387↪gprs:nanobts+band-900↪iperf3.py:8] 09:42:13.138154 tst iperf3.py:8: Test FAILED (7.4 sec) 09:42:13.165236 run osmo-hlr_10.42.42.2(pid=1172): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1172)] 09:42:13.213443 run osmo-hlr_10.42.42.2(pid=1172): stdout: | (launched: 2022-12-13_09:42:10.026965) 09:42:13.262860 run osmo-hlr_10.42.42.2(pid=1172): stderr: | 20221213094210204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094210205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094210205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094210205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094210205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094210205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094210217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094210226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094210227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094210227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:13.313355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1167): Terminating (SIGTERM) 09:42:13.353238 run iperf3-srv_10.42.42.10(pid=1168): Terminating (SIGTERM) 09:42:13.393178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1171): Terminating (SIGTERM) 09:42:13.433054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1176): Terminating (SIGTERM) 09:42:13.472744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1179): Terminating (SIGTERM) 09:42:13.513035 --- ParallelTerminationStrategy: PID 1167 died... 09:42:13.532387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1167): Terminated: ok {rc=0} 09:42:13.576703 --- ParallelTerminationStrategy: PID 1168 died... 09:42:13.595457 run iperf3-srv_10.42.42.10(pid=1168): Terminated {rc=256} 09:42:13.639444 --- ParallelTerminationStrategy: PID 1171 died... 09:42:13.658218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1171): Terminated: ok {rc=0} 09:42:13.701974 --- ParallelTerminationStrategy: PID 1176 died... 09:42:13.720743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1176): Terminated: ok {rc=0} 09:42:13.764616 --- ParallelTerminationStrategy: PID 1179 died... 09:42:13.783584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1179): Terminated: ok {rc=0} 09:42:13.869749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 09:42:15.015376 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.026594 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:42:15.073271 tst iperf3m4.py: using LAC 33103 09:42:15.190468 tst iperf3m4.py: using RAC 208 09:42:15.306542 tst iperf3m4.py: using CellId 33103 09:42:15.422975 tst iperf3m4.py: using BVCI 33104 09:42:15.533652 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.544300 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.554815 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.565232 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.575625 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.586278 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.597952 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.609109 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:15.619904 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:42:15.735473 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:42:15.863063 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:42:15.994796 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:42:16.114597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:42:16.339549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:42:16.675435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1181): Launched 09:42:16.973785 run iperf3-srv_10.42.42.10(pid=1182): Launched 09:42:17.106422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:42:17.327082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:42:17.648383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1183): Launched 09:42:17.926039 run iperf3-srv_10.42.42.10(pid=1184): Launched 09:42:18.046051 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:42:18.262705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:42:18.584071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1185): Launched 09:42:18.861671 run iperf3-srv_10.42.42.10(pid=1186): Launched 09:42:18.981405 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:42:19.198164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:42:19.520004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1187): Launched 09:42:19.797603 run iperf3-srv_10.42.42.10(pid=1188): Launched 09:42:19.917187 tst iperf3m4.py:8: start network... 09:42:20.132700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:20.631817 run create_hlr_db(pid=1189): Launched 09:42:20.761218 bus /gobi_6: Setting Powered False 09:42:21.821574 run create_hlr_db(pid=1189): Terminated: ok {rc=0} 09:42:22.269303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1191): Launched 09:42:22.589999 run osmo-hlr_10.42.42.2(pid=1192): Launched 09:42:22.711369 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:23.270501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1194): Launched 09:42:23.591453 run osmo-stp_10.42.42.5(pid=1195): Launched 09:42:23.713214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:42:24.270239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1197): Launched 09:42:24.392084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:42:24.662149 run patchelf(pid=1198): Launched 09:42:24.839378 run osmo-stp_10.42.42.5(pid=1195): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1195)] 09:42:24.975103 run osmo-stp_10.42.42.5(pid=1195): stdout: | (launched: 2022-12-13_09:42:23.532787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:25.111876 run osmo-stp_10.42.42.5(pid=1195): stderr: | 20221213094223724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094223724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094223724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094223724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094223727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094223727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094223727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:25.249645 run osmo-stp_10.42.42.5(pid=1195): stdout: | (launched: 2022-12-13_09:42:23.532787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:25.381282 run osmo-stp_10.42.42.5(pid=1195): stderr: | 20221213094223724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094223724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094223724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094223724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094223727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094223727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094223727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:25.537307 run patchelf(pid=1198): Terminating (SIGINT) 09:42:25.716504 run patchelf(pid=1198): Terminated: ok {rc=0} 09:42:25.846458 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1195): Process ended prematurely: osmo-stp_10.42.42.5(pid=1195) [trial-2387↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1195)] [trial-2387↪gprs:nanobts+band-900↪iperf3m4.py:8] 09:42:25.856317 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:42:25.885077 run osmo-hlr_10.42.42.2(pid=1192): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1192)] 09:42:25.935217 run osmo-hlr_10.42.42.2(pid=1192): stdout: | (launched: 2022-12-13_09:42:22.531585) 09:42:25.986970 run osmo-hlr_10.42.42.2(pid=1192): stderr: | 20221213094222729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094222729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094222729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094222729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094222730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094222730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094222742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094222750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094222750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094222750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:26.039062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1181): Terminating (SIGTERM) 09:42:26.080544 run iperf3-srv_10.42.42.10(pid=1182): Terminating (SIGTERM) 09:42:26.122241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1183): Terminating (SIGTERM) 09:42:26.163887 run iperf3-srv_10.42.42.10(pid=1184): Terminating (SIGTERM) 09:42:26.206634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1185): Terminating (SIGTERM) 09:42:26.248830 run iperf3-srv_10.42.42.10(pid=1186): Terminating (SIGTERM) 09:42:26.290924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1187): Terminating (SIGTERM) 09:42:26.332683 run iperf3-srv_10.42.42.10(pid=1188): Terminating (SIGTERM) 09:42:26.374650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1191): Terminating (SIGTERM) 09:42:26.416726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1194): Terminating (SIGTERM) 09:42:26.458202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1197): Terminating (SIGTERM) 09:42:26.500405 --- ParallelTerminationStrategy: PID 1181 died... 09:42:26.520775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1181): Terminated: ok {rc=0} 09:42:26.567288 --- ParallelTerminationStrategy: PID 1182 died... 09:42:26.587020 run iperf3-srv_10.42.42.10(pid=1182): Terminated {rc=256} 09:42:26.633140 --- ParallelTerminationStrategy: PID 1183 died... 09:42:26.652604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1183): Terminated: ok {rc=0} 09:42:26.698675 --- ParallelTerminationStrategy: PID 1184 died... 09:42:26.718371 run iperf3-srv_10.42.42.10(pid=1184): Terminated {rc=256} 09:42:26.764341 --- ParallelTerminationStrategy: PID 1185 died... 09:42:26.784219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1185): Terminated: ok {rc=0} 09:42:26.830281 --- ParallelTerminationStrategy: PID 1186 died... 09:42:26.849893 run iperf3-srv_10.42.42.10(pid=1186): Terminated {rc=256} 09:42:26.895814 --- ParallelTerminationStrategy: PID 1187 died... 09:42:26.915562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1187): Terminated: ok {rc=0} 09:42:26.961771 --- ParallelTerminationStrategy: PID 1188 died... 09:42:26.981493 run iperf3-srv_10.42.42.10(pid=1188): Terminated {rc=256} 09:42:27.027710 --- ParallelTerminationStrategy: PID 1191 died... 09:42:27.047365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1191): Terminated: ok {rc=0} 09:42:27.093352 --- ParallelTerminationStrategy: PID 1194 died... 09:42:27.112688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1194): Terminated: ok {rc=0} 09:42:27.159117 --- ParallelTerminationStrategy: PID 1197 died... 09:42:27.179035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1197): Terminated: ok {rc=0} 09:42:27.267337 bus /gobi_4: Setting Powered False 09:42:28.366495 bus /gobi_4: Setting Powered False 09:42:29.482344 bus /gobi_1: Setting Powered False 09:42:30.581278 bus /gobi_1: Setting Powered False 09:42:31.694808 bus /gobi_0: Setting Powered False 09:42:32.790571 bus /gobi_0: Setting Powered False 09:42:33.907015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900 ping.py ---------------------------------------------- 09:42:35.010365 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.021573 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:42:35.069080 tst ping.py: using LAC 33104 09:42:35.184862 tst ping.py: using RAC 209 09:42:35.300737 tst ping.py: using CellId 33104 09:42:35.417182 tst ping.py: using BVCI 33105 09:42:35.533255 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.544597 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.555884 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.567095 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.578735 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.590936 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.602820 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:35.614519 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:42:35.730643 tst ping.py:19: start network... 09:42:35.927574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:36.382446 run create_hlr_db(pid=1199): Launched 09:42:36.495137 bus /gobi_6: Setting Powered False 09:42:37.553541 run create_hlr_db(pid=1199): Terminated: ok {rc=0} 09:42:37.982873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1201): Launched 09:42:38.295680 run osmo-hlr_10.42.42.2(pid=1202): Launched 09:42:38.415893 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:38.961783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1204): Launched 09:42:39.276114 run osmo-stp_10.42.42.5(pid=1205): Launched 09:42:39.396902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:42:39.939751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1207): Launched 09:42:40.060301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:42:40.325764 run patchelf(pid=1208): Launched 09:42:40.500045 run osmo-stp_10.42.42.5(pid=1205): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1205)] 09:42:40.633126 run osmo-stp_10.42.42.5(pid=1205): stdout: | (launched: 2022-12-13_09:42:39.218678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:40.767255 run osmo-stp_10.42.42.5(pid=1205): stderr: | 20221213094239409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094239409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094239409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094239410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094239412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094239413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094239413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:40.902064 run osmo-stp_10.42.42.5(pid=1205): stdout: | (launched: 2022-12-13_09:42:39.218678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:41.031127 run osmo-stp_10.42.42.5(pid=1205): stderr: | 20221213094239409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094239409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094239409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094239410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094239412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094239413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094239413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:41.184681 run patchelf(pid=1208): Terminating (SIGINT) 09:42:41.361019 run patchelf(pid=1208): Terminated: ok {rc=0} 09:42:41.488537 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1205): Process ended prematurely: osmo-stp_10.42.42.5(pid=1205) [trial-2387↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1205)] [trial-2387↪gprs:nanobts+band-900↪ping.py:22] 09:42:41.498185 tst ping.py:22: Test FAILED (6.5 sec) 09:42:41.525959 run osmo-hlr_10.42.42.2(pid=1202): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1202)] 09:42:41.575923 run osmo-hlr_10.42.42.2(pid=1202): stdout: | (launched: 2022-12-13_09:42:38.238595) 09:42:41.627663 run osmo-hlr_10.42.42.2(pid=1202): stderr: | 20221213094238434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094238434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094238434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094238434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094238434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094238434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094238446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094238454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094238455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094238455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:41.679605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1201): Terminating (SIGTERM) 09:42:41.721223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1204): Terminating (SIGTERM) 09:42:41.762723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1207): Terminating (SIGTERM) 09:42:41.804476 --- ParallelTerminationStrategy: PID 1201 died... 09:42:41.824882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1201): Terminated: ok {rc=0} 09:42:41.871149 --- ParallelTerminationStrategy: PID 1204 died... 09:42:41.890978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1204): Terminated: ok {rc=0} 09:42:41.937685 --- ParallelTerminationStrategy: PID 1207 died... 09:42:41.957531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1207): Terminated: ok {rc=0} 09:42:42.044989 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 09:42:43.132047 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.143755 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:42:43.195534 tst ping_idle_ping.py: using LAC 33105 09:42:43.319355 tst ping_idle_ping.py: using RAC 210 09:42:43.443560 tst ping_idle_ping.py: using CellId 33105 09:42:43.567237 tst ping_idle_ping.py: using BVCI 33106 09:42:43.682539 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.693885 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.704806 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.715803 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.726723 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.737619 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.748567 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:42:43.759640 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:42:43.874220 tst ping_idle_ping.py:24: start network... 09:42:44.086033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:44.577346 run create_hlr_db(pid=1209): Launched 09:42:44.705016 bus /gobi_6: Setting Powered False 09:42:45.768156 run create_hlr_db(pid=1209): Terminated: ok {rc=0} 09:42:46.230218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1211): Launched 09:42:46.554063 run osmo-hlr_10.42.42.2(pid=1212): Launched 09:42:46.783552 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:47.488775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1214): Launched 09:42:47.782695 run osmo-stp_10.42.42.5(pid=1215): Launched 09:42:47.895520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:42:48.403492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1217): Launched 09:42:48.515498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:42:48.763928 run patchelf(pid=1218): Launched 09:42:48.927955 run osmo-stp_10.42.42.5(pid=1215): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1215)] 09:42:49.053192 run osmo-stp_10.42.42.5(pid=1215): stdout: | (launched: 2022-12-13_09:42:47.728845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:49.179981 run osmo-stp_10.42.42.5(pid=1215): stderr: | 20221213094247898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094247898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094247899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094247899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094247899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094247899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094247899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:49.306907 run osmo-stp_10.42.42.5(pid=1215): stdout: | (launched: 2022-12-13_09:42:47.728845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:49.428130 run osmo-stp_10.42.42.5(pid=1215): stderr: | 20221213094247898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094247898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094247899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094247899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094247899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094247899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094247899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:49.571888 run patchelf(pid=1218): Terminating (SIGINT) 09:42:49.738149 run patchelf(pid=1218): Terminated: ok {rc=0} 09:42:49.857592 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1215): Process ended prematurely: osmo-stp_10.42.42.5(pid=1215) [trial-2387↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1215)] [trial-2387↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 09:42:49.866556 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:42:49.893427 run osmo-hlr_10.42.42.2(pid=1212): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1212)] 09:42:49.941768 run osmo-hlr_10.42.42.2(pid=1212): stdout: | (launched: 2022-12-13_09:42:46.484400) 09:42:49.990994 run osmo-hlr_10.42.42.2(pid=1212): stderr: | 20221213094246828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094246828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094246828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094246828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094246828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094246829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094246841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094246853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094246853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094246853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:50.040674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1211): Terminating (SIGTERM) 09:42:50.080517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1214): Terminating (SIGTERM) 09:42:50.120300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1217): Terminating (SIGTERM) 09:42:50.160595 --- ParallelTerminationStrategy: PID 1211 died... 09:42:50.179957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1211): Terminated: ok {rc=0} 09:42:50.223888 --- ParallelTerminationStrategy: PID 1214 died... 09:42:50.242847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1214): Terminated: ok {rc=0} 09:42:50.286941 --- ParallelTerminationStrategy: PID 1217 died... 09:42:50.306038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1217): Terminated: ok {rc=0} 09:42:50.391871 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 09:42:51.694903 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:51.701717 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:42:51.734469 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:42:51.775112 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:42:51.866628 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:42:51.900044 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:42:51.940543 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:42:52.537678 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:42:52.589893 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:52.601135 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:42:52.650725 tst cs_paging_gprs_active.py: using LAC 33106 09:42:52.777438 tst cs_paging_gprs_active.py: using RAC 211 09:42:52.897191 tst cs_paging_gprs_active.py: using CellId 33106 09:42:53.024656 tst cs_paging_gprs_active.py: using BVCI 33107 09:42:53.141141 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.152631 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.163773 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.175152 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.186232 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.197425 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.208808 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.219915 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:42:53.231211 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:42:53.347136 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:42:53.467830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:42:53.686010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:42:54.007784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1222): Launched 09:42:54.286470 run iperf3-srv_10.42.42.10(pid=1223): Launched 09:42:54.407030 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:42:54.623238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:42:54.945118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1224): Launched 09:42:55.223636 run iperf3-srv_10.42.42.10(pid=1225): Launched 09:42:55.344155 tst cs_paging_gprs_active.py:38: start network... 09:42:55.560159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:56.055854 run create_hlr_db(pid=1226): Launched 09:42:56.185570 bus /gobi_6: Setting Powered False 09:42:57.249411 run create_hlr_db(pid=1226): Terminated: ok {rc=0} 09:42:57.677579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1228): Launched 09:42:57.979125 run osmo-hlr_10.42.42.2(pid=1229): Launched 09:42:58.093969 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:58.625047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1232): Launched 09:42:58.924499 run osmo-stp_10.42.42.5(pid=1233): Launched 09:42:59.039798 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:42:59.556250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1235): Launched 09:42:59.671419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:42:59.924054 run patchelf(pid=1236): Launched 09:43:00.090734 run osmo-stp_10.42.42.5(pid=1233): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1233)] 09:43:00.217619 run osmo-stp_10.42.42.5(pid=1233): stdout: | (launched: 2022-12-13_09:42:58.869647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:00.345960 run osmo-stp_10.42.42.5(pid=1233): stderr: | 20221213094259042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094259042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094259043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094259043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094259043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094259043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094259044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:00.474468 run osmo-stp_10.42.42.5(pid=1233): stdout: | (launched: 2022-12-13_09:42:58.869647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:00.597254 run osmo-stp_10.42.42.5(pid=1233): stderr: | 20221213094259042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094259042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094259043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094259043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094259043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094259043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094259044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:00.742736 run patchelf(pid=1236): Terminating (SIGINT) 09:43:00.930498 run patchelf(pid=1236): Terminated: ok {rc=0} 09:43:01.093635 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1233): Process ended prematurely: osmo-stp_10.42.42.5(pid=1233) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1233)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:43:01.104099 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:43:01.133465 run osmo-hlr_10.42.42.2(pid=1229): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1229)] 09:43:01.184565 run osmo-hlr_10.42.42.2(pid=1229): stdout: | (launched: 2022-12-13_09:42:57.923485) 09:43:01.237434 run osmo-hlr_10.42.42.2(pid=1229): stderr: | 20221213094258100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094258101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094258101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094258101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094258101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094258101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094258113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094258123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094258123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094258123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:01.290264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1222): Terminating (SIGTERM) 09:43:01.333034 run iperf3-srv_10.42.42.10(pid=1223): Terminating (SIGTERM) 09:43:01.378843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1224): Terminating (SIGTERM) 09:43:01.422323 run iperf3-srv_10.42.42.10(pid=1225): Terminating (SIGTERM) 09:43:01.467387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1228): Terminating (SIGTERM) 09:43:01.509930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1232): Terminating (SIGTERM) 09:43:01.552017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1235): Terminating (SIGTERM) 09:43:01.594391 --- ParallelTerminationStrategy: PID 1222 died... 09:43:01.615287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1222): Terminated: ok {rc=0} 09:43:01.661971 --- ParallelTerminationStrategy: PID 1223 died... 09:43:01.682860 run iperf3-srv_10.42.42.10(pid=1223): Terminated {rc=256} 09:43:01.729215 --- ParallelTerminationStrategy: PID 1224 died... 09:43:01.750070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1224): Terminated: ok {rc=0} 09:43:01.796619 --- ParallelTerminationStrategy: PID 1225 died... 09:43:01.817535 run iperf3-srv_10.42.42.10(pid=1225): Terminated {rc=256} 09:43:01.864645 --- ParallelTerminationStrategy: PID 1228 died... 09:43:01.885928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1228): Terminated: ok {rc=0} 09:43:01.932624 --- ParallelTerminationStrategy: PID 1232 died... 09:43:01.953353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1232): Terminated: ok {rc=0} 09:43:01.999715 --- ParallelTerminationStrategy: PID 1235 died... 09:43:02.020351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1235): Terminated: ok {rc=0} 09:43:02.107352 bus /gobi_0: Setting Powered False 09:43:03.203780 bus /gobi_0: Setting Powered False 09:43:04.314667 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:43:05.462589 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:05.474665 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:43:05.526183 tst iperf3.py: using LAC 33107 09:43:05.653578 tst iperf3.py: using RAC 212 09:43:05.772608 tst iperf3.py: using CellId 33107 09:43:05.899067 tst iperf3.py: using BVCI 33108 09:43:06.016864 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.028522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.039936 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.051380 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.062701 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.073766 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.085020 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.096144 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:06.107555 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:43:06.222789 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:43:06.423901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:43:06.725137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1237): Launched 09:43:06.986180 run iperf3-srv_10.42.42.10(pid=1238): Launched 09:43:07.098897 tst iperf3.py:8: start network... 09:43:07.300504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:07.764332 run create_hlr_db(pid=1239): Launched 09:43:07.878961 bus /gobi_6: Setting Powered False 09:43:08.938361 run create_hlr_db(pid=1239): Terminated: ok {rc=0} 09:43:09.375038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1241): Launched 09:43:09.695204 run osmo-hlr_10.42.42.2(pid=1242): Launched 09:43:09.817217 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:10.373890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1244): Launched 09:43:10.694114 run osmo-stp_10.42.42.5(pid=1245): Launched 09:43:10.816000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:43:11.368015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1247): Launched 09:43:11.490389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:43:11.761115 run patchelf(pid=1248): Launched 09:43:11.938662 run osmo-stp_10.42.42.5(pid=1245): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1245)] 09:43:12.074798 run osmo-stp_10.42.42.5(pid=1245): stdout: | (launched: 2022-12-13_09:43:10.635626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:12.212204 run osmo-stp_10.42.42.5(pid=1245): stderr: | 20221213094310829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094310829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094310829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094310829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094310830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094310830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094310830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:12.350027 run osmo-stp_10.42.42.5(pid=1245): stdout: | (launched: 2022-12-13_09:43:10.635626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:12.481368 run osmo-stp_10.42.42.5(pid=1245): stderr: | 20221213094310829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094310829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094310829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094310829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094310830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094310830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094310830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:12.637417 run patchelf(pid=1248): Terminating (SIGINT) 09:43:12.817082 run patchelf(pid=1248): Terminated: ok {rc=0} 09:43:12.946494 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1245): Process ended prematurely: osmo-stp_10.42.42.5(pid=1245) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1245)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 09:43:12.956795 tst iperf3.py:8: Test FAILED (7.5 sec) 09:43:12.985642 run osmo-hlr_10.42.42.2(pid=1242): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1242)] 09:43:13.035750 run osmo-hlr_10.42.42.2(pid=1242): stdout: | (launched: 2022-12-13_09:43:09.637201) 09:43:13.087458 run osmo-hlr_10.42.42.2(pid=1242): stderr: | 20221213094309834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094309834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094309834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094309834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094309834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094309834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094309846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094309855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094309855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094309855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:13.139686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1237): Terminating (SIGTERM) 09:43:13.181435 run iperf3-srv_10.42.42.10(pid=1238): Terminating (SIGTERM) 09:43:13.223592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1241): Terminating (SIGTERM) 09:43:13.265548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1244): Terminating (SIGTERM) 09:43:13.307081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1247): Terminating (SIGTERM) 09:43:13.349806 --- ParallelTerminationStrategy: PID 1237 died... 09:43:13.369935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1237): Terminated: ok {rc=0} 09:43:13.416155 --- ParallelTerminationStrategy: PID 1238 died... 09:43:13.435630 run iperf3-srv_10.42.42.10(pid=1238): Terminated {rc=256} 09:43:13.481538 --- ParallelTerminationStrategy: PID 1241 died... 09:43:13.501137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1241): Terminated: ok {rc=0} 09:43:13.546976 --- ParallelTerminationStrategy: PID 1244 died... 09:43:13.566581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1244): Terminated: ok {rc=0} 09:43:13.612514 --- ParallelTerminationStrategy: PID 1247 died... 09:43:13.632079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1247): Terminated: ok {rc=0} 09:43:13.719484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:43:14.868293 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:14.880372 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:43:14.930694 tst iperf3m4.py: using LAC 33108 09:43:15.057787 tst iperf3m4.py: using RAC 213 09:43:15.187564 tst iperf3m4.py: using CellId 33108 09:43:15.313799 tst iperf3m4.py: using BVCI 33109 09:43:15.430351 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.441923 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.453193 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.464408 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.475585 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.486767 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.498161 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.509346 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:15.520587 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:43:15.636927 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:43:15.758799 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:43:15.882841 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:43:16.008930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:43:16.226727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:43:16.542564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1249): Launched 09:43:16.830696 run iperf3-srv_10.42.42.10(pid=1250): Launched 09:43:16.960010 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:43:17.167409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:43:17.470982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1251): Launched 09:43:17.732663 run iperf3-srv_10.42.42.10(pid=1252): Launched 09:43:17.845213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:43:18.045397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:43:18.345504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1253): Launched 09:43:18.605720 run iperf3-srv_10.42.42.10(pid=1254): Launched 09:43:18.718383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:43:18.919220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:43:19.220094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1255): Launched 09:43:19.480161 run iperf3-srv_10.42.42.10(pid=1256): Launched 09:43:19.592763 tst iperf3m4.py:8: start network... 09:43:19.793724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:20.257296 run create_hlr_db(pid=1257): Launched 09:43:20.372520 bus /gobi_6: Setting Powered False 09:43:21.432674 run create_hlr_db(pid=1257): Terminated: ok {rc=0} 09:43:21.849216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1259): Launched 09:43:22.148069 run osmo-hlr_10.42.42.2(pid=1260): Launched 09:43:22.262475 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:22.792223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1262): Launched 09:43:23.093089 run osmo-stp_10.42.42.5(pid=1263): Launched 09:43:23.208033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:43:23.723769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1265): Launched 09:43:23.837694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:43:24.090214 run patchelf(pid=1266): Launched 09:43:24.256666 run osmo-stp_10.42.42.5(pid=1263): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1263)] 09:43:24.382903 run osmo-stp_10.42.42.5(pid=1263): stdout: | (launched: 2022-12-13_09:43:23.037546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:24.510876 run osmo-stp_10.42.42.5(pid=1263): stderr: | 20221213094323208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094323209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094323209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094323209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094323210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094323210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094323210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:24.638511 run osmo-stp_10.42.42.5(pid=1263): stdout: | (launched: 2022-12-13_09:43:23.037546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:24.761286 run osmo-stp_10.42.42.5(pid=1263): stderr: | 20221213094323208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094323209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094323209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094323209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094323210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094323210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094323210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:24.906296 run patchelf(pid=1266): Terminating (SIGINT) 09:43:25.073870 run patchelf(pid=1266): Terminated: ok {rc=0} 09:43:25.194818 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1263): Process ended prematurely: osmo-stp_10.42.42.5(pid=1263) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1263)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 09:43:25.204140 tst iperf3m4.py:8: Test FAILED (10.4 sec) 09:43:25.231434 run osmo-hlr_10.42.42.2(pid=1260): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1260)] 09:43:25.279157 run osmo-hlr_10.42.42.2(pid=1260): stdout: | (launched: 2022-12-13_09:43:22.093517) 09:43:25.328296 run osmo-hlr_10.42.42.2(pid=1260): stderr: | 20221213094322267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094322268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094322268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094322268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094322268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094322268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094322280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094322288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094322288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094322288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:25.377822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1249): Terminating (SIGTERM) 09:43:25.417404 run iperf3-srv_10.42.42.10(pid=1250): Terminating (SIGTERM) 09:43:25.457200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1251): Terminating (SIGTERM) 09:43:25.496890 run iperf3-srv_10.42.42.10(pid=1252): Terminating (SIGTERM) 09:43:25.536313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1253): Terminating (SIGTERM) 09:43:25.575750 run iperf3-srv_10.42.42.10(pid=1254): Terminating (SIGTERM) 09:43:25.614995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1255): Terminating (SIGTERM) 09:43:25.654402 run iperf3-srv_10.42.42.10(pid=1256): Terminating (SIGTERM) 09:43:25.693872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1259): Terminating (SIGTERM) 09:43:25.734407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1262): Terminating (SIGTERM) 09:43:25.775009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1265): Terminating (SIGTERM) 09:43:25.815729 --- ParallelTerminationStrategy: PID 1249 died... 09:43:25.835185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1249): Terminated: ok {rc=0} 09:43:25.879872 --- ParallelTerminationStrategy: PID 1250 died... 09:43:25.898589 run iperf3-srv_10.42.42.10(pid=1250): Terminated {rc=256} 09:43:25.942200 --- ParallelTerminationStrategy: PID 1251 died... 09:43:25.960930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1251): Terminated: ok {rc=0} 09:43:26.004438 --- ParallelTerminationStrategy: PID 1252 died... 09:43:26.023093 run iperf3-srv_10.42.42.10(pid=1252): Terminated {rc=256} 09:43:26.066642 --- ParallelTerminationStrategy: PID 1253 died... 09:43:26.085347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1253): Terminated: ok {rc=0} 09:43:26.128921 --- ParallelTerminationStrategy: PID 1254 died... 09:43:26.147666 run iperf3-srv_10.42.42.10(pid=1254): Terminated {rc=256} 09:43:26.191060 --- ParallelTerminationStrategy: PID 1255 died... 09:43:26.209904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1255): Terminated: ok {rc=0} 09:43:26.253530 --- ParallelTerminationStrategy: PID 1256 died... 09:43:26.272196 run iperf3-srv_10.42.42.10(pid=1256): Terminated {rc=256} 09:43:26.315751 --- ParallelTerminationStrategy: PID 1259 died... 09:43:26.334437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1259): Terminated: ok {rc=0} 09:43:26.377906 --- ParallelTerminationStrategy: PID 1262 died... 09:43:26.396623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1262): Terminated: ok {rc=0} 09:43:26.440162 --- ParallelTerminationStrategy: PID 1265 died... 09:43:26.458938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1265): Terminated: ok {rc=0} 09:43:26.544138 bus /gobi_4: Setting Powered False 09:43:27.643020 bus /gobi_4: Setting Powered False 09:43:28.755077 bus /gobi_1: Setting Powered False 09:43:29.852119 bus /gobi_1: Setting Powered False 09:43:30.984454 bus /gobi_0: Setting Powered False 09:43:32.082672 bus /gobi_0: Setting Powered False 09:43:33.202971 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 09:43:34.306473 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.318095 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:43:34.366546 tst ping.py: using LAC 33109 09:43:34.484220 tst ping.py: using RAC 214 09:43:34.599843 tst ping.py: using CellId 33109 09:43:34.715766 tst ping.py: using BVCI 33110 09:43:34.822595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.833820 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.844422 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.855390 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.866491 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.877751 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.888621 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:34.900072 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:43:35.019234 tst ping.py:19: start network... 09:43:35.231178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:35.717507 run create_hlr_db(pid=1267): Launched 09:43:35.845968 bus /gobi_6: Setting Powered False 09:43:36.908841 run create_hlr_db(pid=1267): Terminated: ok {rc=0} 09:43:37.327548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1269): Launched 09:43:37.620746 run osmo-hlr_10.42.42.2(pid=1270): Launched 09:43:37.733546 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:38.253731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1272): Launched 09:43:38.546283 run osmo-stp_10.42.42.5(pid=1273): Launched 09:43:38.657687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:43:39.163909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1275): Launched 09:43:39.275936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:43:39.523480 run patchelf(pid=1276): Launched 09:43:39.687248 run osmo-stp_10.42.42.5(pid=1273): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1273)] 09:43:39.811858 run osmo-stp_10.42.42.5(pid=1273): stdout: | (launched: 2022-12-13_09:43:38.492425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:39.939024 run osmo-stp_10.42.42.5(pid=1273): stderr: | 20221213094338660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094338660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094338661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094338661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094338663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094338663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094338664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:40.065927 run osmo-stp_10.42.42.5(pid=1273): stdout: | (launched: 2022-12-13_09:43:38.492425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:40.187141 run osmo-stp_10.42.42.5(pid=1273): stderr: | 20221213094338660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094338660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094338661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094338661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094338663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094338663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094338664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:40.330731 run patchelf(pid=1276): Terminating (SIGINT) 09:43:40.495763 run patchelf(pid=1276): Terminated: ok {rc=0} 09:43:40.614661 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1273): Process ended prematurely: osmo-stp_10.42.42.5(pid=1273) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1273)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 09:43:40.623420 tst ping.py:22: Test FAILED (6.3 sec) 09:43:40.649983 run osmo-hlr_10.42.42.2(pid=1270): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1270)] 09:43:40.697364 run osmo-hlr_10.42.42.2(pid=1270): stdout: | (launched: 2022-12-13_09:43:37.566611) 09:43:40.746288 run osmo-hlr_10.42.42.2(pid=1270): stderr: | 20221213094337742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094337742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094337742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094337742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094337742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094337742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094337754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094337763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094337763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094337764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:40.795813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1269): Terminating (SIGTERM) 09:43:40.835503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1272): Terminating (SIGTERM) 09:43:40.875240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1275): Terminating (SIGTERM) 09:43:40.915496 --- ParallelTerminationStrategy: PID 1269 died... 09:43:40.934968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1269): Terminated: ok {rc=0} 09:43:40.979167 --- ParallelTerminationStrategy: PID 1272 died... 09:43:40.998084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1272): Terminated: ok {rc=0} 09:43:41.042196 --- ParallelTerminationStrategy: PID 1275 died... 09:43:41.061158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1275): Terminated: ok {rc=0} 09:43:41.147242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:43:42.234351 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.246010 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:43:42.294246 tst ping_idle_ping.py: using LAC 33110 09:43:42.415231 tst ping_idle_ping.py: using RAC 215 09:43:42.531857 tst ping_idle_ping.py: using CellId 33110 09:43:42.647368 tst ping_idle_ping.py: using BVCI 33111 09:43:42.754309 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.765412 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.776191 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.786892 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.797943 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.808775 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.819900 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:43:42.830997 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:43:42.945724 tst ping_idle_ping.py:24: start network... 09:43:43.142798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:43.600297 run create_hlr_db(pid=1277): Launched 09:43:43.712921 bus /gobi_6: Setting Powered False 09:43:44.771994 run create_hlr_db(pid=1277): Terminated: ok {rc=0} 09:43:45.203799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1279): Launched 09:43:45.519308 run osmo-hlr_10.42.42.2(pid=1280): Launched 09:43:45.640275 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:46.213350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1282): Launched 09:43:46.546480 run osmo-stp_10.42.42.5(pid=1283): Launched 09:43:46.835063 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:43:47.363851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1285): Launched 09:43:47.492674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:43:47.747042 run patchelf(pid=1286): Launched 09:43:47.911643 run osmo-stp_10.42.42.5(pid=1283): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1283)] 09:43:48.037311 run osmo-stp_10.42.42.5(pid=1283): stdout: | (launched: 2022-12-13_09:43:46.487507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:48.164069 run osmo-stp_10.42.42.5(pid=1283): stderr: | 20221213094346674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094346674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094346674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094346674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094346675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094346675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094346675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:48.290789 run osmo-stp_10.42.42.5(pid=1283): stdout: | (launched: 2022-12-13_09:43:46.487507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:48.412308 run osmo-stp_10.42.42.5(pid=1283): stderr: | 20221213094346674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094346674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094346674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094346674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094346675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094346675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094346675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:48.556006 run patchelf(pid=1286): Terminating (SIGINT) 09:43:48.721899 run patchelf(pid=1286): Terminated: ok {rc=0} 09:43:48.841465 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1283): Process ended prematurely: osmo-stp_10.42.42.5(pid=1283) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1283)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:43:48.850242 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:43:48.876672 run osmo-hlr_10.42.42.2(pid=1280): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1280)] 09:43:48.924846 run osmo-hlr_10.42.42.2(pid=1280): stdout: | (launched: 2022-12-13_09:43:45.462159) 09:43:48.974412 run osmo-hlr_10.42.42.2(pid=1280): stderr: | 20221213094345659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094345659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094345659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094345659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094345659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094345660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094345679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094345688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094345688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094345688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:49.024096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1279): Terminating (SIGTERM) 09:43:49.064044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1282): Terminating (SIGTERM) 09:43:49.103746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1285): Terminating (SIGTERM) 09:43:49.143792 --- ParallelTerminationStrategy: PID 1279 died... 09:43:49.163397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1279): Terminated: ok {rc=0} 09:43:49.207253 --- ParallelTerminationStrategy: PID 1282 died... 09:43:49.226247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1282): Terminated: ok {rc=0} 09:43:49.270342 --- ParallelTerminationStrategy: PID 1285 died... 09:43:49.289446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1285): Terminated: ok {rc=0} 09:43:49.375571 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:43:50.686017 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:50.693895 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:43:50.727481 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:43:50.767061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:43:50.857106 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:43:50.890902 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:43:50.930368 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:43:51.524424 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:43:51.576342 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:51.587845 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:43:51.655878 tst cs_paging_gprs_active.py: using LAC 33111 09:43:51.781473 tst cs_paging_gprs_active.py: using RAC 216 09:43:51.906795 tst cs_paging_gprs_active.py: using CellId 33111 09:43:52.032833 tst cs_paging_gprs_active.py: using BVCI 33112 09:43:52.148802 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.160171 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.171353 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.182584 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.193766 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.205099 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.216506 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.227822 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:43:52.239539 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:43:52.355611 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:43:52.472076 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:43:52.673864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:43:52.975109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1290): Launched 09:43:53.235804 run iperf3-srv_10.42.42.10(pid=1291): Launched 09:43:53.348067 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:43:53.548811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:43:53.849211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1292): Launched 09:43:54.110816 run iperf3-srv_10.42.42.10(pid=1293): Launched 09:43:54.223363 tst cs_paging_gprs_active.py:38: start network... 09:43:54.423764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:54.888721 run create_hlr_db(pid=1294): Launched 09:43:55.004378 bus /gobi_6: Setting Powered False 09:43:56.064397 run create_hlr_db(pid=1294): Terminated: ok {rc=0} 09:43:56.502209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1296): Launched 09:43:56.822766 run osmo-hlr_10.42.42.2(pid=1297): Launched 09:43:56.945456 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:57.496453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1299): Launched 09:43:57.816516 run osmo-stp_10.42.42.5(pid=1300): Launched 09:43:57.939367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:43:58.494183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1302): Launched 09:43:58.616656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:43:58.887913 run patchelf(pid=1303): Launched 09:43:59.065828 run osmo-stp_10.42.42.5(pid=1300): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1300)] 09:43:59.201179 run osmo-stp_10.42.42.5(pid=1300): stdout: | (launched: 2022-12-13_09:43:57.758425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:59.338968 run osmo-stp_10.42.42.5(pid=1300): stderr: | 20221213094357950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094357951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094357951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094357951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094357952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094357952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094357952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:59.476157 run osmo-stp_10.42.42.5(pid=1300): stdout: | (launched: 2022-12-13_09:43:57.758425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:59.607635 run osmo-stp_10.42.42.5(pid=1300): stderr: | 20221213094357950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094357951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094357951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094357951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094357952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094357952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094357952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:59.763208 run patchelf(pid=1303): Terminating (SIGINT) 09:43:59.942767 run patchelf(pid=1303): Terminated: ok {rc=0} 09:44:00.072476 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1300): Process ended prematurely: osmo-stp_10.42.42.5(pid=1300) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1300)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:44:00.082699 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:44:00.111449 run osmo-hlr_10.42.42.2(pid=1297): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1297)] 09:44:00.161088 run osmo-hlr_10.42.42.2(pid=1297): stdout: | (launched: 2022-12-13_09:43:56.764532) 09:44:00.212366 run osmo-hlr_10.42.42.2(pid=1297): stderr: | 20221213094356965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094356965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094356965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094356965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094356965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094356965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094356980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094356990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094356990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094356990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:00.264697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1290): Terminating (SIGTERM) 09:44:00.306250 run iperf3-srv_10.42.42.10(pid=1291): Terminating (SIGTERM) 09:44:00.347671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1292): Terminating (SIGTERM) 09:44:00.389105 run iperf3-srv_10.42.42.10(pid=1293): Terminating (SIGTERM) 09:44:00.430746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1296): Terminating (SIGTERM) 09:44:00.472171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1299): Terminating (SIGTERM) 09:44:00.513890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1302): Terminating (SIGTERM) 09:44:00.556144 --- ParallelTerminationStrategy: PID 1290 died... 09:44:00.575948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1290): Terminated: ok {rc=0} 09:44:00.621824 --- ParallelTerminationStrategy: PID 1291 died... 09:44:00.641153 run iperf3-srv_10.42.42.10(pid=1291): Terminated {rc=256} 09:44:00.686420 --- ParallelTerminationStrategy: PID 1292 died... 09:44:00.705758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1292): Terminated: ok {rc=0} 09:44:00.751008 --- ParallelTerminationStrategy: PID 1293 died... 09:44:00.770217 run iperf3-srv_10.42.42.10(pid=1293): Terminated {rc=256} 09:44:00.815391 --- ParallelTerminationStrategy: PID 1296 died... 09:44:00.834648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1296): Terminated: ok {rc=0} 09:44:00.915097 --- ParallelTerminationStrategy: PID 1299 died... 09:44:00.935448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1299): Terminated: ok {rc=0} 09:44:00.981707 --- ParallelTerminationStrategy: PID 1302 died... 09:44:01.001807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1302): Terminated: ok {rc=0} 09:44:01.093681 bus /gobi_0: Setting Powered False 09:44:02.190883 bus /gobi_0: Setting Powered False 09:44:03.302253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:44:04.449902 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:04.461770 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:44:04.535202 tst iperf3.py: using LAC 33112 09:44:04.661368 tst iperf3.py: using RAC 217 09:44:04.787232 tst iperf3.py: using CellId 33112 09:44:04.912675 tst iperf3.py: using BVCI 33113 09:44:05.028752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.040241 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.051530 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.062772 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.074009 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.085318 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.096510 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.107686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:05.119034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:44:05.235102 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:44:05.436132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:44:05.736665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1304): Launched 09:44:05.998585 run iperf3-srv_10.42.42.10(pid=1305): Launched 09:44:06.112123 tst iperf3.py:8: start network... 09:44:06.313329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:06.778073 run create_hlr_db(pid=1306): Launched 09:44:06.909595 bus /gobi_6: Setting Powered False 09:44:07.973342 run create_hlr_db(pid=1306): Terminated: ok {rc=0} 09:44:08.400642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1309): Launched 09:44:08.722138 run osmo-hlr_10.42.42.2(pid=1310): Launched 09:44:08.843419 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:09.397996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1312): Launched 09:44:09.716309 run osmo-stp_10.42.42.5(pid=1313): Launched 09:44:09.837481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:44:10.389292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1315): Launched 09:44:10.510897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:44:10.780551 run patchelf(pid=1316): Launched 09:44:10.958036 run osmo-stp_10.42.42.5(pid=1313): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1313)] 09:44:11.093356 run osmo-stp_10.42.42.5(pid=1313): stdout: | (launched: 2022-12-13_09:44:09.658147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:11.230201 run osmo-stp_10.42.42.5(pid=1313): stderr: | 20221213094409851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094409851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094409852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094409852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094409854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094409855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094409855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:11.367332 run osmo-stp_10.42.42.5(pid=1313): stdout: | (launched: 2022-12-13_09:44:09.658147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:11.498442 run osmo-stp_10.42.42.5(pid=1313): stderr: | 20221213094409851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094409851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094409852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094409852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094409854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094409855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094409855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:11.653988 run patchelf(pid=1316): Terminating (SIGINT) 09:44:11.833604 run patchelf(pid=1316): Terminated: ok {rc=0} 09:44:11.963139 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1313): Process ended prematurely: osmo-stp_10.42.42.5(pid=1313) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1313)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:44:11.973237 tst iperf3.py:8: Test FAILED (7.6 sec) 09:44:12.001498 run osmo-hlr_10.42.42.2(pid=1310): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1310)] 09:44:12.050965 run osmo-hlr_10.42.42.2(pid=1310): stdout: | (launched: 2022-12-13_09:44:08.664091) 09:44:12.102964 run osmo-hlr_10.42.42.2(pid=1310): stderr: | 20221213094408863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094408863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094408863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094408863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094408863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094408863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094408877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094408885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094408885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094408885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:12.155053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1304): Terminating (SIGTERM) 09:44:12.196387 run iperf3-srv_10.42.42.10(pid=1305): Terminating (SIGTERM) 09:44:12.237980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1309): Terminating (SIGTERM) 09:44:12.279424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1312): Terminating (SIGTERM) 09:44:12.320640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1315): Terminating (SIGTERM) 09:44:12.362309 --- ParallelTerminationStrategy: PID 1304 died... 09:44:12.382276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1304): Terminated: ok {rc=0} 09:44:12.428495 --- ParallelTerminationStrategy: PID 1305 died... 09:44:12.448131 run iperf3-srv_10.42.42.10(pid=1305): Terminated {rc=256} 09:44:12.493941 --- ParallelTerminationStrategy: PID 1309 died... 09:44:12.513382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1309): Terminated: ok {rc=0} 09:44:12.558979 --- ParallelTerminationStrategy: PID 1312 died... 09:44:12.578512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1312): Terminated: ok {rc=0} 09:44:12.624591 --- ParallelTerminationStrategy: PID 1315 died... 09:44:12.644200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1315): Terminated: ok {rc=0} 09:44:12.730662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:44:13.877948 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:13.889474 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:44:13.955453 tst iperf3m4.py: using LAC 33113 09:44:14.073745 tst iperf3m4.py: using RAC 218 09:44:14.193159 tst iperf3m4.py: using CellId 33113 09:44:14.310462 tst iperf3m4.py: using BVCI 33114 09:44:14.421619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.432668 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.443714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.454654 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.465934 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.476932 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.488255 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.499486 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:14.510907 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:44:14.630606 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:44:14.749752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:44:14.869216 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:44:14.986807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:44:15.189894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:44:15.492428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1317): Launched 09:44:15.754820 run iperf3-srv_10.42.42.10(pid=1318): Launched 09:44:15.890595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:44:16.118846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:44:16.461520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1319): Launched 09:44:16.767162 run iperf3-srv_10.42.42.10(pid=1320): Launched 09:44:16.899624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:44:17.121349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:44:17.447019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1321): Launched 09:44:17.726076 run iperf3-srv_10.42.42.10(pid=1322): Launched 09:44:17.846149 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:44:18.062391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:44:18.385489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1323): Launched 09:44:18.664080 run iperf3-srv_10.42.42.10(pid=1324): Launched 09:44:18.784021 tst iperf3m4.py:8: start network... 09:44:19.000371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:19.497514 run create_hlr_db(pid=1325): Launched 09:44:19.627501 bus /gobi_6: Setting Powered False 09:44:20.690685 run create_hlr_db(pid=1325): Terminated: ok {rc=0} 09:44:21.117163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1327): Launched 09:44:21.417265 run osmo-hlr_10.42.42.2(pid=1328): Launched 09:44:21.532365 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:22.066634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1330): Launched 09:44:22.368357 run osmo-stp_10.42.42.5(pid=1331): Launched 09:44:22.483151 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:44:23.000254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1333): Launched 09:44:23.114373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:44:23.367037 run patchelf(pid=1334): Launched 09:44:23.533291 run osmo-stp_10.42.42.5(pid=1331): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1331)] 09:44:23.660011 run osmo-stp_10.42.42.5(pid=1331): stdout: | (launched: 2022-12-13_09:44:22.312751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:23.788201 run osmo-stp_10.42.42.5(pid=1331): stderr: | 20221213094422483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094422483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094422484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094422484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094422484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094422485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094422485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:23.916376 run osmo-stp_10.42.42.5(pid=1331): stdout: | (launched: 2022-12-13_09:44:22.312751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:24.039158 run osmo-stp_10.42.42.5(pid=1331): stderr: | 20221213094422483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094422483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094422484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094422484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094422484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094422485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094422485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:24.184730 run patchelf(pid=1334): Terminating (SIGINT) 09:44:24.354194 run patchelf(pid=1334): Terminated: ok {rc=0} 09:44:24.476171 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1331): Process ended prematurely: osmo-stp_10.42.42.5(pid=1331) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1331)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:44:24.485855 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:44:24.512669 run osmo-hlr_10.42.42.2(pid=1328): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1328)] 09:44:24.560533 run osmo-hlr_10.42.42.2(pid=1328): stdout: | (launched: 2022-12-13_09:44:21.362377) 09:44:24.609620 run osmo-hlr_10.42.42.2(pid=1328): stderr: | 20221213094421538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094421538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094421539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094421539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094421539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094421539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094421551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094421560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094421560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094421560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:24.659058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1317): Terminating (SIGTERM) 09:44:24.698699 run iperf3-srv_10.42.42.10(pid=1318): Terminating (SIGTERM) 09:44:24.738461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1319): Terminating (SIGTERM) 09:44:24.778180 run iperf3-srv_10.42.42.10(pid=1320): Terminating (SIGTERM) 09:44:24.817622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1321): Terminating (SIGTERM) 09:44:24.857261 run iperf3-srv_10.42.42.10(pid=1322): Terminating (SIGTERM) 09:44:24.896870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1323): Terminating (SIGTERM) 09:44:24.936486 run iperf3-srv_10.42.42.10(pid=1324): Terminating (SIGTERM) 09:44:24.975970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1327): Terminating (SIGTERM) 09:44:25.015452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1330): Terminating (SIGTERM) 09:44:25.055196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1333): Terminating (SIGTERM) 09:44:25.094980 --- ParallelTerminationStrategy: PID 1317 died... 09:44:25.114657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1317): Terminated: ok {rc=0} 09:44:25.158637 --- ParallelTerminationStrategy: PID 1318 died... 09:44:25.177570 run iperf3-srv_10.42.42.10(pid=1318): Terminated {rc=256} 09:44:25.221384 --- ParallelTerminationStrategy: PID 1319 died... 09:44:25.240248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1319): Terminated: ok {rc=0} 09:44:25.284013 --- ParallelTerminationStrategy: PID 1320 died... 09:44:25.302963 run iperf3-srv_10.42.42.10(pid=1320): Terminated {rc=256} 09:44:25.346783 --- ParallelTerminationStrategy: PID 1321 died... 09:44:25.365707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1321): Terminated: ok {rc=0} 09:44:25.409528 --- ParallelTerminationStrategy: PID 1322 died... 09:44:25.428361 run iperf3-srv_10.42.42.10(pid=1322): Terminated {rc=256} 09:44:25.471967 --- ParallelTerminationStrategy: PID 1323 died... 09:44:25.491131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1323): Terminated: ok {rc=0} 09:44:25.534901 --- ParallelTerminationStrategy: PID 1324 died... 09:44:25.553859 run iperf3-srv_10.42.42.10(pid=1324): Terminated {rc=256} 09:44:25.597603 --- ParallelTerminationStrategy: PID 1327 died... 09:44:25.616563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1327): Terminated: ok {rc=0} 09:44:25.660630 --- ParallelTerminationStrategy: PID 1330 died... 09:44:25.679678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1330): Terminated: ok {rc=0} 09:44:25.723489 --- ParallelTerminationStrategy: PID 1333 died... 09:44:25.742457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1333): Terminated: ok {rc=0} 09:44:25.827775 bus /gobi_4: Setting Powered False 09:44:26.925846 bus /gobi_4: Setting Powered False 09:44:28.038846 bus /gobi_1: Setting Powered False 09:44:29.135672 bus /gobi_1: Setting Powered False 09:44:30.249622 bus /gobi_0: Setting Powered False 09:44:31.361583 bus /gobi_0: Setting Powered False 09:44:32.479244 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:44:33.581919 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:33.594086 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:44:33.663670 tst ping.py: using LAC 33114 09:44:33.787020 tst ping.py: using RAC 219 09:44:33.910068 tst ping.py: using CellId 33114 09:44:34.037820 tst ping.py: using BVCI 33115 09:44:34.147873 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:34.159208 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:34.170061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:34.181161 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:34.192217 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:34.203552 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:34.214720 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:34.225744 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:44:34.344817 tst ping.py:19: start network... 09:44:34.555947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:35.040592 run create_hlr_db(pid=1335): Launched 09:44:35.168447 bus /gobi_6: Setting Powered False 09:44:36.230673 run create_hlr_db(pid=1335): Terminated: ok {rc=0} 09:44:36.668934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1337): Launched 09:44:36.983327 run osmo-hlr_10.42.42.2(pid=1338): Launched 09:44:37.102440 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:37.651460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1340): Launched 09:44:37.965131 run osmo-stp_10.42.42.5(pid=1341): Launched 09:44:38.085032 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:44:38.630359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1343): Launched 09:44:38.750474 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:44:39.016616 run patchelf(pid=1344): Launched 09:44:39.191673 run osmo-stp_10.42.42.5(pid=1341): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1341)] 09:44:39.325698 run osmo-stp_10.42.42.5(pid=1341): stdout: | (launched: 2022-12-13_09:44:37.907865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:39.460205 run osmo-stp_10.42.42.5(pid=1341): stderr: | 20221213094438098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094438098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094438098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094438098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094438099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094438099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094438099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:39.595240 run osmo-stp_10.42.42.5(pid=1341): stdout: | (launched: 2022-12-13_09:44:37.907865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:39.724338 run osmo-stp_10.42.42.5(pid=1341): stderr: | 20221213094438098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094438098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094438098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094438098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094438099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094438099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094438099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:39.877653 run patchelf(pid=1344): Terminating (SIGINT) 09:44:40.054195 run patchelf(pid=1344): Terminated: ok {rc=0} 09:44:40.181033 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1341): Process ended prematurely: osmo-stp_10.42.42.5(pid=1341) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1341)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 09:44:40.190512 tst ping.py:22: Test FAILED (6.6 sec) 09:44:40.218459 run osmo-hlr_10.42.42.2(pid=1338): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1338)] 09:44:40.268356 run osmo-hlr_10.42.42.2(pid=1338): stdout: | (launched: 2022-12-13_09:44:36.925039) 09:44:40.319826 run osmo-hlr_10.42.42.2(pid=1338): stderr: | 20221213094437122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094437122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094437122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094437122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094437122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094437122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094437135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094437144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094437144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094437144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:40.372138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1337): Terminating (SIGTERM) 09:44:40.413597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1340): Terminating (SIGTERM) 09:44:40.455014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1343): Terminating (SIGTERM) 09:44:40.496675 --- ParallelTerminationStrategy: PID 1337 died... 09:44:40.516615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1337): Terminated: ok {rc=0} 09:44:40.562288 --- ParallelTerminationStrategy: PID 1340 died... 09:44:40.581975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1340): Terminated: ok {rc=0} 09:44:40.627991 --- ParallelTerminationStrategy: PID 1343 died... 09:44:40.647613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1343): Terminated: ok {rc=0} 09:44:40.735148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:44:41.820625 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:41.832719 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:44:41.901385 tst ping_idle_ping.py: using LAC 33115 09:44:42.020074 tst ping_idle_ping.py: using RAC 220 09:44:42.135589 tst ping_idle_ping.py: using CellId 33115 09:44:42.252771 tst ping_idle_ping.py: using BVCI 33116 09:44:42.360033 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:42.371071 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:42.382095 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:42.392895 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:42.403936 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:42.414990 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:42.426151 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:44:42.437252 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:44:42.555913 tst ping_idle_ping.py:24: start network... 09:44:42.769362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:43.264186 run create_hlr_db(pid=1345): Launched 09:44:43.394236 bus /gobi_6: Setting Powered False 09:44:44.457518 run create_hlr_db(pid=1345): Terminated: ok {rc=0} 09:44:44.898405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1347): Launched 09:44:45.213262 run osmo-hlr_10.42.42.2(pid=1348): Launched 09:44:45.334651 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:45.890699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1350): Launched 09:44:46.237710 run osmo-stp_10.42.42.5(pid=1351): Launched 09:44:46.364374 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:44:47.052324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1353): Launched 09:44:47.181909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:44:47.450352 run patchelf(pid=1354): Launched 09:44:47.626089 run osmo-stp_10.42.42.5(pid=1351): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1351)] 09:44:47.759145 run osmo-stp_10.42.42.5(pid=1351): stdout: | (launched: 2022-12-13_09:44:46.167056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:47.893957 run osmo-stp_10.42.42.5(pid=1351): stderr: | 20221213094446473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094446473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094446473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094446474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094446474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094446474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094446474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:48.028836 run osmo-stp_10.42.42.5(pid=1351): stdout: | (launched: 2022-12-13_09:44:46.167056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:48.158467 run osmo-stp_10.42.42.5(pid=1351): stderr: | 20221213094446473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094446473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094446473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094446474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094446474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094446474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094446474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:48.312022 run patchelf(pid=1354): Terminating (SIGINT) 09:44:48.489241 run patchelf(pid=1354): Terminated: ok {rc=0} 09:44:48.616294 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1351): Process ended prematurely: osmo-stp_10.42.42.5(pid=1351) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1351)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:44:48.625802 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 09:44:48.653575 run osmo-hlr_10.42.42.2(pid=1348): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1348)] 09:44:48.702711 run osmo-hlr_10.42.42.2(pid=1348): stdout: | (launched: 2022-12-13_09:44:45.155669) 09:44:48.753659 run osmo-hlr_10.42.42.2(pid=1348): stderr: | 20221213094445352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094445352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094445352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094445352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094445352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094445352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094445365 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094445373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094445373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094445373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:48.804821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1347): Terminating (SIGTERM) 09:44:48.845849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1350): Terminating (SIGTERM) 09:44:48.887140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1353): Terminating (SIGTERM) 09:44:48.928571 --- ParallelTerminationStrategy: PID 1347 died... 09:44:48.948413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1347): Terminated: ok {rc=0} 09:44:48.993814 --- ParallelTerminationStrategy: PID 1350 died... 09:44:49.012835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1350): Terminated: ok {rc=0} 09:44:49.058414 --- ParallelTerminationStrategy: PID 1353 died... 09:44:49.077931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1353): Terminated: ok {rc=0} 09:44:49.163945 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:44:50.475122 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:50.482846 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:44:50.515249 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:44:50.555650 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:44:50.644474 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:44:50.677083 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:44:50.716472 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:44:51.319351 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:44:51.370745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:51.382492 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:44:51.433095 tst cs_paging_gprs_active.py: using LAC 33116 09:44:51.557138 tst cs_paging_gprs_active.py: using RAC 221 09:44:51.681199 tst cs_paging_gprs_active.py: using CellId 33116 09:44:51.806604 tst cs_paging_gprs_active.py: using BVCI 33117 09:44:51.923237 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:51.935048 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:51.946592 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:51.958211 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:51.969803 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:51.981342 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:51.993025 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:52.004535 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:44:52.016279 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:44:52.134745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:44:52.252540 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:44:52.466681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:44:52.783466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1360): Launched 09:44:53.057195 run iperf3-srv_10.42.42.10(pid=1361): Launched 09:44:53.175295 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:44:53.388549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:44:53.705439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1362): Launched 09:44:53.979766 run iperf3-srv_10.42.42.10(pid=1363): Launched 09:44:54.097852 tst cs_paging_gprs_active.py:38: start network... 09:44:54.310258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:54.800886 run create_hlr_db(pid=1364): Launched 09:44:54.930285 bus /gobi_6: Setting Powered False 09:44:55.993037 run create_hlr_db(pid=1364): Terminated: ok {rc=0} 09:44:56.433653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1366): Launched 09:44:56.748785 run osmo-hlr_10.42.42.2(pid=1367): Launched 09:44:56.869925 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:57.412629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1369): Launched 09:44:57.728193 run osmo-stp_10.42.42.5(pid=1370): Launched 09:44:57.849502 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:44:58.396738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1372): Launched 09:44:58.517659 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:44:58.785414 run patchelf(pid=1373): Launched 09:44:58.961192 run osmo-stp_10.42.42.5(pid=1370): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1370)] 09:44:59.095163 run osmo-stp_10.42.42.5(pid=1370): stdout: | (launched: 2022-12-13_09:44:57.670892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:59.230777 run osmo-stp_10.42.42.5(pid=1370): stderr: | 20221213094457864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094457864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094457864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094457865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094457865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094457865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094457865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:59.366721 run osmo-stp_10.42.42.5(pid=1370): stdout: | (launched: 2022-12-13_09:44:57.670892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:59.496562 run osmo-stp_10.42.42.5(pid=1370): stderr: | 20221213094457864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094457864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094457864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094457865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094457865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094457865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094457865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:59.650104 run patchelf(pid=1373): Terminating (SIGINT) 09:44:59.827857 run patchelf(pid=1373): Terminated: ok {rc=0} 09:44:59.956031 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1370): Process ended prematurely: osmo-stp_10.42.42.5(pid=1370) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1370)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:44:59.966221 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:44:59.994007 run osmo-hlr_10.42.42.2(pid=1367): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1367)] 09:45:00.043507 run osmo-hlr_10.42.42.2(pid=1367): stdout: | (launched: 2022-12-13_09:44:56.691816) 09:45:00.094807 run osmo-hlr_10.42.42.2(pid=1367): stderr: | 20221213094456890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094456890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094456890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094456890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094456890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094456890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094456904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094456914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094456914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094456914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:00.146349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1360): Terminating (SIGTERM) 09:45:00.187792 run iperf3-srv_10.42.42.10(pid=1361): Terminating (SIGTERM) 09:45:00.229299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1362): Terminating (SIGTERM) 09:45:00.271000 run iperf3-srv_10.42.42.10(pid=1363): Terminating (SIGTERM) 09:45:00.312295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1366): Terminating (SIGTERM) 09:45:00.353896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1369): Terminating (SIGTERM) 09:45:00.395091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1372): Terminating (SIGTERM) 09:45:00.436530 --- ParallelTerminationStrategy: PID 1360 died... 09:45:00.456351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1360): Terminated: ok {rc=0} 09:45:00.502324 --- ParallelTerminationStrategy: PID 1361 died... 09:45:00.521652 run iperf3-srv_10.42.42.10(pid=1361): Terminated {rc=256} 09:45:00.566780 --- ParallelTerminationStrategy: PID 1362 died... 09:45:00.585896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1362): Terminated: ok {rc=0} 09:45:00.631284 --- ParallelTerminationStrategy: PID 1363 died... 09:45:00.650399 run iperf3-srv_10.42.42.10(pid=1363): Terminated {rc=256} 09:45:00.695466 --- ParallelTerminationStrategy: PID 1366 died... 09:45:00.714668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1366): Terminated: ok {rc=0} 09:45:00.759683 --- ParallelTerminationStrategy: PID 1369 died... 09:45:00.778776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1369): Terminated: ok {rc=0} 09:45:00.823741 --- ParallelTerminationStrategy: PID 1372 died... 09:45:00.842914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1372): Terminated: ok {rc=0} 09:45:00.933397 bus /gobi_0: Setting Powered False 09:45:02.050662 bus /gobi_0: Setting Powered False 09:45:03.182451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:45:04.326959 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.338707 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:45:04.387453 tst iperf3.py: using LAC 33117 09:45:04.506694 tst iperf3.py: using RAC 222 09:45:04.625395 tst iperf3.py: using CellId 33117 09:45:04.741889 tst iperf3.py: using BVCI 33118 09:45:04.849716 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.860933 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.872145 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.883302 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.894669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.906061 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.917603 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.928879 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:04.940708 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:45:05.057836 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:45:05.256904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:45:05.552815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1384): Launched 09:45:05.809919 run iperf3-srv_10.42.42.10(pid=1385): Launched 09:45:05.920688 tst iperf3.py:8: start network... 09:45:06.118341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:06.575892 run create_hlr_db(pid=1386): Launched 09:45:06.689293 bus /gobi_6: Setting Powered False 09:45:07.748889 run create_hlr_db(pid=1386): Terminated: ok {rc=0} 09:45:08.180183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1388): Launched 09:45:08.497649 run osmo-hlr_10.42.42.2(pid=1389): Launched 09:45:08.619135 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:09.162398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1391): Launched 09:45:09.477673 run osmo-stp_10.42.42.5(pid=1392): Launched 09:45:09.598632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:45:10.143881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1394): Launched 09:45:10.264702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:45:10.532034 run patchelf(pid=1395): Launched 09:45:10.708812 run osmo-stp_10.42.42.5(pid=1392): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1392)] 09:45:10.843169 run osmo-stp_10.42.42.5(pid=1392): stdout: | (launched: 2022-12-13_09:45:09.420665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:10.978582 run osmo-stp_10.42.42.5(pid=1392): stderr: | 20221213094509613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094509613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094509613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094509614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094509614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094509614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094509614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:11.114315 run osmo-stp_10.42.42.5(pid=1392): stdout: | (launched: 2022-12-13_09:45:09.420665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:11.244101 run osmo-stp_10.42.42.5(pid=1392): stderr: | 20221213094509613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094509613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094509613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094509614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094509614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094509614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094509614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:11.399004 run patchelf(pid=1395): Terminating (SIGINT) 09:45:11.576763 run patchelf(pid=1395): Terminated: ok {rc=0} 09:45:11.705190 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1392): Process ended prematurely: osmo-stp_10.42.42.5(pid=1392) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1392)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:45:11.715176 tst iperf3.py:8: Test FAILED (7.4 sec) 09:45:11.743387 run osmo-hlr_10.42.42.2(pid=1389): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1389)] 09:45:11.793369 run osmo-hlr_10.42.42.2(pid=1389): stdout: | (launched: 2022-12-13_09:45:08.440537) 09:45:11.845896 run osmo-hlr_10.42.42.2(pid=1389): stderr: | 20221213094508637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094508637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094508637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094508637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094508637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094508637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094508649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094508658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094508658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094508658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:11.898953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1384): Terminating (SIGTERM) 09:45:11.942094 run iperf3-srv_10.42.42.10(pid=1385): Terminating (SIGTERM) 09:45:11.988376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1388): Terminating (SIGTERM) 09:45:12.031717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1391): Terminating (SIGTERM) 09:45:12.073973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1394): Terminating (SIGTERM) 09:45:12.116343 --- ParallelTerminationStrategy: PID 1384 died... 09:45:12.136207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1384): Terminated: ok {rc=0} 09:45:12.182562 --- ParallelTerminationStrategy: PID 1385 died... 09:45:12.203496 run iperf3-srv_10.42.42.10(pid=1385): Terminated {rc=256} 09:45:12.250438 --- ParallelTerminationStrategy: PID 1388 died... 09:45:12.270665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1388): Terminated: ok {rc=0} 09:45:12.317140 --- ParallelTerminationStrategy: PID 1391 died... 09:45:12.337203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1391): Terminated: ok {rc=0} 09:45:12.384750 --- ParallelTerminationStrategy: PID 1394 died... 09:45:12.404673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1394): Terminated: ok {rc=0} 09:45:12.491094 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:45:13.651254 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:13.664760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:45:13.720002 tst iperf3m4.py: using LAC 33118 09:45:13.846250 tst iperf3m4.py: using RAC 223 09:45:13.973436 tst iperf3m4.py: using CellId 33118 09:45:14.101305 tst iperf3m4.py: using BVCI 33119 09:45:14.209466 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.220902 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.232278 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.243731 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.256009 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.268141 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.280561 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.293019 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:14.305541 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:45:14.423458 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:45:14.543974 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:45:14.659383 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:45:14.778603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:45:14.994186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:45:15.311912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1747): Launched 09:45:15.587223 run iperf3-srv_10.42.42.10(pid=1748): Launched 09:45:15.706430 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:45:15.922014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:45:16.249841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1749): Launched 09:45:16.543028 run iperf3-srv_10.42.42.10(pid=1750): Launched 09:45:16.677184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:45:16.894297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:45:17.216083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1751): Launched 09:45:17.490852 run iperf3-srv_10.42.42.10(pid=1752): Launched 09:45:17.609160 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:45:17.822322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:45:18.139631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1753): Launched 09:45:18.414757 run iperf3-srv_10.42.42.10(pid=1754): Launched 09:45:18.533279 tst iperf3m4.py:8: start network... 09:45:18.747234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:19.237569 run create_hlr_db(pid=1755): Launched 09:45:19.365911 bus /gobi_6: Setting Powered False 09:45:20.428147 run create_hlr_db(pid=1755): Terminated: ok {rc=0} 09:45:20.869462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1757): Launched 09:45:21.186911 run osmo-hlr_10.42.42.2(pid=1758): Launched 09:45:21.306762 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:21.851999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1760): Launched 09:45:22.171569 run osmo-stp_10.42.42.5(pid=1761): Launched 09:45:22.289618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:45:22.937772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1861): Launched 09:45:23.063225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:45:23.338050 run patchelf(pid=1943): Launched 09:45:23.516315 run osmo-stp_10.42.42.5(pid=1761): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1761)] 09:45:23.647621 run osmo-stp_10.42.42.5(pid=1761): stdout: | (launched: 2022-12-13_09:45:22.112052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:23.780730 run osmo-stp_10.42.42.5(pid=1761): stderr: | 20221213094522323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094522323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094522323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094522323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094522324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094522324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094522324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:23.912631 run osmo-stp_10.42.42.5(pid=1761): stdout: | (launched: 2022-12-13_09:45:22.112052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:24.040151 run osmo-stp_10.42.42.5(pid=1761): stderr: | 20221213094522323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094522323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094522323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094522323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094522324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094522324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094522324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:24.189596 run patchelf(pid=1943): Terminating (SIGINT) 09:45:24.360181 run patchelf(pid=1943): Terminated: ok {rc=0} 09:45:24.484489 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1761): Process ended prematurely: osmo-stp_10.42.42.5(pid=1761) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1761)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:45:24.495743 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:45:24.524187 run osmo-hlr_10.42.42.2(pid=1758): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1758)] 09:45:24.575227 run osmo-hlr_10.42.42.2(pid=1758): stdout: | (launched: 2022-12-13_09:45:21.128111) 09:45:24.627885 run osmo-hlr_10.42.42.2(pid=1758): stderr: | 20221213094521328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094521328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094521328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094521328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094521328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094521328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094521340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094521349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094521349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094521349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:24.681384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1747): Terminating (SIGTERM) 09:45:24.722629 run iperf3-srv_10.42.42.10(pid=1748): Terminating (SIGTERM) 09:45:24.767056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1749): Terminating (SIGTERM) 09:45:24.810835 run iperf3-srv_10.42.42.10(pid=1750): Terminating (SIGTERM) 09:45:24.856009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1751): Terminating (SIGTERM) 09:45:24.898541 run iperf3-srv_10.42.42.10(pid=1752): Terminating (SIGTERM) 09:45:24.944472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1753): Terminating (SIGTERM) 09:45:24.987936 run iperf3-srv_10.42.42.10(pid=1754): Terminating (SIGTERM) 09:45:25.032807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1757): Terminating (SIGTERM) 09:45:25.075530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1760): Terminating (SIGTERM) 09:45:25.119432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1861): Terminating (SIGTERM) 09:45:25.163517 --- ParallelTerminationStrategy: PID 1747 died... 09:45:25.185873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1747): Terminated: ok {rc=0} 09:45:25.233345 --- ParallelTerminationStrategy: PID 1748 died... 09:45:25.253936 run iperf3-srv_10.42.42.10(pid=1748): Terminated {rc=256} 09:45:25.299951 --- ParallelTerminationStrategy: PID 1749 died... 09:45:25.320748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1749): Terminated: ok {rc=0} 09:45:25.367229 --- ParallelTerminationStrategy: PID 1750 died... 09:45:25.388790 run iperf3-srv_10.42.42.10(pid=1750): Terminated {rc=256} 09:45:25.434927 --- ParallelTerminationStrategy: PID 1751 died... 09:45:25.455623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1751): Terminated: ok {rc=0} 09:45:25.501554 --- ParallelTerminationStrategy: PID 1752 died... 09:45:25.522351 run iperf3-srv_10.42.42.10(pid=1752): Terminated {rc=256} 09:45:25.567318 --- ParallelTerminationStrategy: PID 1753 died... 09:45:25.589978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1753): Terminated: ok {rc=0} 09:45:25.636067 --- ParallelTerminationStrategy: PID 1754 died... 09:45:25.656872 run iperf3-srv_10.42.42.10(pid=1754): Terminated {rc=256} 09:45:25.703330 --- ParallelTerminationStrategy: PID 1757 died... 09:45:25.723955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1757): Terminated: ok {rc=0} 09:45:25.769999 --- ParallelTerminationStrategy: PID 1760 died... 09:45:25.791906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1760): Terminated: ok {rc=0} 09:45:25.837816 --- ParallelTerminationStrategy: PID 1861 died... 09:45:25.858477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1861): Terminated: ok {rc=0} 09:45:25.948500 bus /gobi_4: Setting Powered False 09:45:27.047048 bus /gobi_4: Setting Powered False 09:45:28.159369 bus /gobi_1: Setting Powered False 09:45:29.255690 bus /gobi_1: Setting Powered False 09:45:30.369453 bus /gobi_0: Setting Powered False 09:45:31.469263 bus /gobi_0: Setting Powered False 09:45:32.584922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:45:33.686495 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:33.698800 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:45:33.748930 tst ping.py: using LAC 33119 09:45:33.865238 tst ping.py: using RAC 224 09:45:33.980837 tst ping.py: using CellId 33119 09:45:34.095821 tst ping.py: using BVCI 33120 09:45:34.201761 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:34.213409 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:34.224704 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:34.235881 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:34.247207 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:34.258638 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:34.270179 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:34.281661 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:45:34.399330 tst ping.py:19: start network... 09:45:34.609170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:35.092815 run create_hlr_db(pid=1946): Launched 09:45:35.220678 bus /gobi_6: Setting Powered False 09:45:36.282862 run create_hlr_db(pid=1946): Terminated: ok {rc=0} 09:45:36.717686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1948): Launched 09:45:37.029036 run osmo-hlr_10.42.42.2(pid=1949): Launched 09:45:37.147130 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:37.685034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1951): Launched 09:45:37.995085 run osmo-stp_10.42.42.5(pid=1952): Launched 09:45:38.113492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:45:38.651530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1954): Launched 09:45:38.770577 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:45:39.033550 run patchelf(pid=1955): Launched 09:45:39.207043 run osmo-stp_10.42.42.5(pid=1952): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1952)] 09:45:39.340011 run osmo-stp_10.42.42.5(pid=1952): stdout: | (launched: 2022-12-13_09:45:37.938467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:39.473439 run osmo-stp_10.42.42.5(pid=1952): stderr: | 20221213094538130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094538130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094538131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094538131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094538132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094538132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094538132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:39.607412 run osmo-stp_10.42.42.5(pid=1952): stdout: | (launched: 2022-12-13_09:45:37.938467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:39.735763 run osmo-stp_10.42.42.5(pid=1952): stderr: | 20221213094538130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094538130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094538131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094538131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094538132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094538132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094538132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:39.887340 run patchelf(pid=1955): Terminating (SIGINT) 09:45:40.058629 run patchelf(pid=1955): Terminated: ok {rc=0} 09:45:40.178018 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1952): Process ended prematurely: osmo-stp_10.42.42.5(pid=1952) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1952)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:45:40.187283 tst ping.py:22: Test FAILED (6.5 sec) 09:45:40.213855 run osmo-hlr_10.42.42.2(pid=1949): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1949)] 09:45:40.261974 run osmo-hlr_10.42.42.2(pid=1949): stdout: | (launched: 2022-12-13_09:45:36.972341) 09:45:40.311855 run osmo-hlr_10.42.42.2(pid=1949): stderr: | 20221213094537171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094537171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094537171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094537171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094537171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094537171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094537186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094537194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094537195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094537195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:40.362221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1948): Terminating (SIGTERM) 09:45:40.402392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1951): Terminating (SIGTERM) 09:45:40.442493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1954): Terminating (SIGTERM) 09:45:40.482501 --- ParallelTerminationStrategy: PID 1948 died... 09:45:40.502029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1948): Terminated: ok {rc=0} 09:45:40.546210 --- ParallelTerminationStrategy: PID 1951 died... 09:45:40.565151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1951): Terminated: ok {rc=0} 09:45:40.609223 --- ParallelTerminationStrategy: PID 1954 died... 09:45:40.627896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1954): Terminated: ok {rc=0} 09:45:40.713459 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:45:41.800840 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:41.813069 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:45:41.867345 tst ping_idle_ping.py: using LAC 33120 09:45:41.987394 tst ping_idle_ping.py: using RAC 225 09:45:42.106976 tst ping_idle_ping.py: using CellId 33120 09:45:42.222592 tst ping_idle_ping.py: using BVCI 33121 09:45:42.329162 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:42.340607 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:42.351753 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:42.362847 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:42.374817 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:42.386791 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:42.398856 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:45:42.410969 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:45:42.531642 tst ping_idle_ping.py:24: start network... 09:45:42.743263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:43.230566 run create_hlr_db(pid=1956): Launched 09:45:43.357875 bus /gobi_6: Setting Powered False 09:45:44.420488 run create_hlr_db(pid=1956): Terminated: ok {rc=0} 09:45:44.841643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1958): Launched 09:45:45.135928 run osmo-hlr_10.42.42.2(pid=1959): Launched 09:45:45.247990 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:45.752107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1961): Launched 09:45:46.069536 run osmo-stp_10.42.42.5(pid=1962): Launched 09:45:46.301596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:45:46.929853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1965): Launched 09:45:47.055088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:45:47.306950 run patchelf(pid=1966): Launched 09:45:47.469069 run osmo-stp_10.42.42.5(pid=1962): ERR: Terminated: ERROR {rc=1} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1962)] 09:45:47.593141 run osmo-stp_10.42.42.5(pid=1962): stdout: | (launched: 2022-12-13_09:45:46.007994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:47.718464 run osmo-stp_10.42.42.5(pid=1962): stderr: | 20221213094546340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094546340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094546340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094546340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094546344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094546344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094546344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:47.844165 run osmo-stp_10.42.42.5(pid=1962): stdout: | (launched: 2022-12-13_09:45:46.007994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:47.964375 run osmo-stp_10.42.42.5(pid=1962): stderr: | 20221213094546340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094546340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094546340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094546340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094546344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094546344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094546344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:48.106768 run patchelf(pid=1966): Terminating (SIGINT) 09:45:48.271870 run patchelf(pid=1966): Terminated: ok {rc=0} 09:45:48.390829 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1962): Process ended prematurely: osmo-stp_10.42.42.5(pid=1962) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1962)] [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:45:48.399648 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:45:48.425977 run osmo-hlr_10.42.42.2(pid=1959): ERR: Terminated: ERROR {rc=237} [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1959)] 09:45:48.473845 run osmo-hlr_10.42.42.2(pid=1959): stdout: | (launched: 2022-12-13_09:45:45.082158) 09:45:48.523207 run osmo-hlr_10.42.42.2(pid=1959): stderr: | 20221213094545257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094545257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094545257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094545257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094545257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094545257 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094545267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094545276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094545277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094545277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:48.573110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1958): Terminating (SIGTERM) 09:45:48.612826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1961): Terminating (SIGTERM) 09:45:48.652626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1965): Terminating (SIGTERM) 09:45:48.692614 --- ParallelTerminationStrategy: PID 1958 died... 09:45:48.711889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1958): Terminated: ok {rc=0} 09:45:48.755717 --- ParallelTerminationStrategy: PID 1961 died... 09:45:48.774208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1961): Terminated: ok {rc=0} 09:45:48.818020 --- ParallelTerminationStrategy: PID 1965 died... 09:45:48.836676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1965): Terminated: ok {rc=0} 09:45:48.921708 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:45:50.235355 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:50.242521 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:45:50.273812 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:45:50.309529 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:45:50.364063 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:45:50.397678 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:45:50.433405 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:45:50.989394 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2387 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:45:50.995118 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.007103 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:45:51.074054 tst switch_tch_pdch.py: using LAC 33121 09:45:51.189294 tst switch_tch_pdch.py: using RAC 226 09:45:51.313436 tst switch_tch_pdch.py: using CellId 33121 09:45:51.441119 tst switch_tch_pdch.py: using BVCI 33122 09:45:51.555983 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.568227 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.580293 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.592235 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.604888 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.617435 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.630150 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:45:51.642757 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:45:51.759465 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:45:51.880336 tst switch_tch_pdch.py:51: start network... 09:45:52.080320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:52.531029 run create_hlr_db(pid=1973): Launched 09:45:52.642954 bus /gobi_6: Setting Powered False 09:45:53.701279 run create_hlr_db(pid=1973): Terminated: ok {rc=0} 09:45:54.127057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1975): Launched 09:45:54.437417 run osmo-hlr_10.42.42.2(pid=1976): Launched 09:45:54.559275 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:55.095821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1978): Launched 09:45:55.407677 run osmo-stp_10.42.42.5(pid=1979): Launched 09:45:55.526361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:45:56.065111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1981): Launched 09:45:56.184651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:45:56.449296 run patchelf(pid=1982): Launched 09:45:56.623204 run osmo-stp_10.42.42.5(pid=1979): ERR: Terminated: ERROR {rc=1} [trial-2387↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1979)] 09:45:56.755813 run osmo-stp_10.42.42.5(pid=1979): stdout: | (launched: 2022-12-13_09:45:55.351173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:56.889894 run osmo-stp_10.42.42.5(pid=1979): stderr: | 20221213094555541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094555541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094555541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094555542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094555542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094555542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094555542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:57.024569 run osmo-stp_10.42.42.5(pid=1979): stdout: | (launched: 2022-12-13_09:45:55.351173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:57.153357 run osmo-stp_10.42.42.5(pid=1979): stderr: | 20221213094555541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094555541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094555541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094555542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094555542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094555542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094555542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:57.306131 run patchelf(pid=1982): Terminating (SIGINT) 09:45:57.480400 run patchelf(pid=1982): Terminated: ok {rc=0} 09:45:57.606737 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1979): Process ended prematurely: osmo-stp_10.42.42.5(pid=1979) [trial-2387↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1979)] [trial-2387↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:45:57.616313 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:45:57.643777 run osmo-hlr_10.42.42.2(pid=1976): ERR: Terminated: ERROR {rc=237} [trial-2387↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1976)] 09:45:57.693298 run osmo-hlr_10.42.42.2(pid=1976): stdout: | (launched: 2022-12-13_09:45:54.381229) 09:45:57.744874 run osmo-hlr_10.42.42.2(pid=1976): stderr: | 20221213094554575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094554575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094554575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094554575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094554576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094554576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094554588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094554596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094554596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094554596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:57.796561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1975): Terminating (SIGTERM) 09:45:57.838203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1978): Terminating (SIGTERM) 09:45:57.879854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1981): Terminating (SIGTERM) 09:45:57.921616 --- ParallelTerminationStrategy: PID 1975 died... 09:45:57.941550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1975): Terminated: ok {rc=0} 09:45:57.987407 --- ParallelTerminationStrategy: PID 1978 died... 09:45:58.006668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1978): Terminated: ok {rc=0} 09:45:58.052265 --- ParallelTerminationStrategy: PID 1981 died... 09:45:58.071681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1981): Terminated: ok {rc=0} 09:45:58.158730 bus /gobi_0: Setting Powered False 09:45:59.256520 bus /gobi_0: Setting Powered False 09:46:00.370875 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2387 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 nitb_smpp --------------------------------------------------------------------- 09:46:01.640040 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:01.643726 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 09:46:01.676854 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 09:46:01.691181 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 09:46:01.733796 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 09:46:01.758943 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 09:46:01.768103 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 09:46:02.284820 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2387 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:46:02.290646 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:46:02.309607 tst esme_connect_policy_acceptall.py: using MSISDN 8088 09:46:02.441692 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:46:02.999094 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1986): Launched 09:46:03.296610 run osmo-nitb_10.42.42.2(pid=1987): Launched 09:46:03.462033 run osmo-nitb_10.42.42.2(pid=1987): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1987)] 09:46:03.596197 run osmo-nitb_10.42.42.2(pid=1987): stdout: | (launched: 2022-12-13_09:46:03.242818) 09:46:03.731984 run osmo-nitb_10.42.42.2(pid=1987): stderr: | (launched: 2022-12-13_09:46:03.287131) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:03.868014 run osmo-nitb_10.42.42.2(pid=1987): stdout: | (launched: 2022-12-13_09:46:03.242818) 09:46:03.998764 run osmo-nitb_10.42.42.2(pid=1987): stderr: | (launched: 2022-12-13_09:46:03.287131) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1987): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1987) [trial-2387↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1987)] 09:46:04.409840 tst osmo-nitb_10.42.42.2(pid=1987): stdout: | (launched: 2022-12-13_09:46:03.242818) 09:46:04.531391 tst osmo-nitb_10.42.42.2(pid=1987): stderr: | (launched: 2022-12-13_09:46:03.287131) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:04.674420 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=1987): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1987) [trial-2387↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1987)] [trial-2387↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 09:46:04.682635 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 09:46:04.689134 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1986): Terminating (SIGTERM) 09:46:04.898863 --- ParallelTerminationStrategy: PID 1986 died... 09:46:04.919317 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1986): Terminated: ok {rc=0} ---------------------------------------------- trial-2387 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 09:46:04.967829 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:46:04.987659 tst esme_connect_policy_closed.py: using MSISDN 8089 09:46:05.108482 tst esme_connect_policy_closed.py: using MSISDN 8090 09:46:05.216571 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:46:05.773661 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1988): Launched 09:46:06.072213 run osmo-nitb_10.42.42.2(pid=1989): Launched 09:46:06.234095 run osmo-nitb_10.42.42.2(pid=1989): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1989)] 09:46:06.357729 run osmo-nitb_10.42.42.2(pid=1989): stdout: | (launched: 2022-12-13_09:46:06.018071) 09:46:06.482569 run osmo-nitb_10.42.42.2(pid=1989): stderr: | (launched: 2022-12-13_09:46:06.062550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:06.607499 run osmo-nitb_10.42.42.2(pid=1989): stdout: | (launched: 2022-12-13_09:46:06.018071) 09:46:06.727302 run osmo-nitb_10.42.42.2(pid=1989): stderr: | (launched: 2022-12-13_09:46:06.062550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:06.870598 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=1989): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1989) [trial-2387↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1989)] [trial-2387↪nitb_smpp↪esme_connect_policy_closed.py:24] 09:46:06.879106 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 09:46:06.885512 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1988): Terminating (SIGTERM) 09:46:07.094485 --- ParallelTerminationStrategy: PID 1988 died... 09:46:07.115390 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1988): Terminated: ok {rc=0} ---------------------------------------------- trial-2387 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:46:07.164123 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:46:07.175936 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:46:07.211440 tst esme_ms_sms_storeforward.py: using LAC 33122 09:46:07.331558 tst esme_ms_sms_storeforward.py: using RAC 227 09:46:07.450608 tst esme_ms_sms_storeforward.py: using CellId 33122 09:46:07.570626 tst esme_ms_sms_storeforward.py: using BVCI 33123 09:46:07.681522 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:46:07.809827 tst esme_ms_sms_storeforward.py: using MSISDN 8091 09:46:07.925472 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 09:46:08.141315 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:46:08.794972 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1990): Launched 09:46:09.116499 run osmo-nitb_10.42.42.2(pid=1991): Launched 09:46:09.289505 run osmo-nitb_10.42.42.2(pid=1991): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1991)] 09:46:09.422185 run osmo-nitb_10.42.42.2(pid=1991): stdout: | (launched: 2022-12-13_09:46:09.058344) 09:46:09.555588 run osmo-nitb_10.42.42.2(pid=1991): stderr: | (launched: 2022-12-13_09:46:09.106624) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:09.689356 run osmo-nitb_10.42.42.2(pid=1991): stdout: | (launched: 2022-12-13_09:46:09.058344) 09:46:09.817100 run osmo-nitb_10.42.42.2(pid=1991): stderr: | (launched: 2022-12-13_09:46:09.106624) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:09.970112 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=1991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1991) [trial-2387↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1991)] [trial-2387↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 09:46:09.978914 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 09:46:09.986296 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1990): Terminating (SIGTERM) 09:46:10.196538 --- ParallelTerminationStrategy: PID 1990 died... 09:46:10.217882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1990): Terminated: ok {rc=0} 09:46:10.305807 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:46:11.393237 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:46:11.404409 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:46:11.443434 tst esme_ms_sms_transaction.py: using LAC 33123 09:46:11.570602 tst esme_ms_sms_transaction.py: using RAC 228 09:46:11.694232 tst esme_ms_sms_transaction.py: using CellId 33123 09:46:11.818468 tst esme_ms_sms_transaction.py: using BVCI 33124 09:46:11.936240 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:46:12.061109 tst esme_ms_sms_transaction.py: using MSISDN 8092 09:46:12.177974 tst esme_ms_sms_transaction.py:18: start nitb and bts... 09:46:12.393813 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:46:13.041361 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1992): Launched 09:46:13.360353 run osmo-nitb_10.42.42.2(pid=1993): Launched 09:46:13.536226 run osmo-nitb_10.42.42.2(pid=1993): ERR: Terminated: ERROR {rc=2} [trial-2387↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1993)] 09:46:13.678499 run osmo-nitb_10.42.42.2(pid=1993): stdout: | (launched: 2022-12-13_09:46:13.302549) 09:46:13.822816 run osmo-nitb_10.42.42.2(pid=1993): stderr: | (launched: 2022-12-13_09:46:13.350438) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:13.966987 run osmo-nitb_10.42.42.2(pid=1993): stdout: | (launched: 2022-12-13_09:46:13.302549) 09:46:14.105898 run osmo-nitb_10.42.42.2(pid=1993): stderr: | (launched: 2022-12-13_09:46:13.350438) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd8774ad268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1993) [trial-2387↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1993)] 09:46:14.480103 tst osmo-nitb_10.42.42.2(pid=1993): stdout: | (launched: 2022-12-13_09:46:13.302549) 09:46:14.610340 tst osmo-nitb_10.42.42.2(pid=1993): stderr: | (launched: 2022-12-13_09:46:13.350438) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:46:14.763237 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=1993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1993) [trial-2387↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1993)] [trial-2387↪nitb_smpp↪esme_ms_sms_transaction.py:21] 09:46:14.772055 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 09:46:14.778943 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1992): Terminating (SIGTERM) 09:46:14.988928 --- ParallelTerminationStrategy: PID 1992 died... 09:46:15.010122 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1992): Terminated: ok {rc=0} 09:46:15.096810 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 smpp --------------------------------------------------------------------- 09:46:16.288219 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:16.292669 tst smpp: Verifying 1 x bts (candidates: 11) 09:46:16.316745 tst smpp: Verifying 6 x ip_address (candidates: 9) 09:46:16.345938 tst smpp: Verifying 1 x modem (candidates: 12) 09:46:16.387511 tst smpp: Reserving 1 x bts (candidates: 11) 09:46:16.416709 tst smpp: Reserving 6 x ip_address (candidates: 9) 09:46:16.461392 tst smpp: Reserving 1 x modem (candidates: 12) 09:46:16.980466 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:46:16.987349 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:16.999135 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:17.010984 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:17.022747 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:17.042993 tst esme_connect_policy_acceptall.py: using MSISDN 8093 09:46:17.196593 run osmo-stp_10.42.42.4: Starting osmo-stp 09:46:17.711848 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1997): Launched 09:46:18.010813 run osmo-stp_10.42.42.4(pid=1998): Launched 09:46:18.125758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:18.589398 run create_hlr_db(pid=1999): Launched 09:46:18.704349 bus /sierra_2: Setting Powered False 09:46:19.763968 run create_hlr_db(pid=1999): Terminated: ok {rc=0} 09:46:20.199581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Launched 09:46:20.518779 run osmo-hlr_10.42.42.2(pid=2002): Launched 09:46:20.641853 run osmo-msc_10.42.42.5: Starting osmo-msc 09:46:21.222407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Launched 09:46:21.542134 run osmo-msc_10.42.42.5(pid=2005): Launched 09:46:21.720907 run osmo-hlr_10.42.42.2(pid=2002): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)] 09:46:21.857815 run osmo-hlr_10.42.42.2(pid=2002): stdout: | (launched: 2022-12-13_09:46:20.461187) 09:46:21.995874 run osmo-hlr_10.42.42.2(pid=2002): stderr: | 20221213094620660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094620661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094620673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094620681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094620682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094620682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:22.131132 run osmo-hlr_10.42.42.2(pid=2002): stdout: | (launched: 2022-12-13_09:46:20.461187) 09:46:22.258817 run osmo-hlr_10.42.42.2(pid=2002): stderr: | 20221213094620660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094620661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094620661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094620673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094620681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094620682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094620682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:22.412329 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=2002): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2002) [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)] [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23] 09:46:22.421482 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.4 sec) 09:46:22.448555 run osmo-msc_10.42.42.5(pid=2005): ERR: Terminated: ERROR {rc=9} [trial-2387↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2005)] 09:46:22.499217 run osmo-msc_10.42.42.5(pid=2005): stdout: | (launched: 2022-12-13_09:46:21.484083) 09:46:22.551268 run osmo-msc_10.42.42.5(pid=2005): stderr: | 20221213094621854 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213094621854 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213094621854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094621854 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213094621854 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213094621854 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213094621854 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213094621854 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213094621855 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:46:22.603224 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1997): Terminating (SIGTERM) 09:46:22.644912 run osmo-stp_10.42.42.4(pid=1998): Terminating (SIGTERM) 09:46:22.686727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Terminating (SIGTERM) 09:46:22.729887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Terminating (SIGTERM) 09:46:22.774534 --- ParallelTerminationStrategy: PID 1997 died... 09:46:22.795138 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1997): Terminated: ok {rc=0} 09:46:22.844187 --- ParallelTerminationStrategy: PID 1998 died... 09:46:22.864037 run osmo-stp_10.42.42.4(pid=1998): Terminated: ok {rc=0} 09:46:22.909929 --- ParallelTerminationStrategy: PID 2001 died... 09:46:22.929675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Terminated: ok {rc=0} 09:46:22.975929 --- ParallelTerminationStrategy: PID 2004 died... 09:46:22.995460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Terminated: ok {rc=0} ---------------------------------------------- trial-2387 smpp esme_connect_policy_closed.py ---------------------------------------------- 09:46:23.046155 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:23.057541 tst smpp: Using 1 x bts (candidates: 1) 09:46:23.092639 tst esme_connect_policy_closed.py: using LAC 33124 09:46:23.219126 tst esme_connect_policy_closed.py: using RAC 229 09:46:23.346271 tst esme_connect_policy_closed.py: using CellId 33124 09:46:23.472485 tst esme_connect_policy_closed.py: using BVCI 33125 09:46:23.582553 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:23.593145 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:23.603458 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:23.622428 tst esme_connect_policy_closed.py: using MSISDN 8094 09:46:23.741232 tst esme_connect_policy_closed.py: using MSISDN 8095 09:46:23.849849 run osmo-stp_10.42.42.4: Starting osmo-stp 09:46:24.359050 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2008): Launched 09:46:24.658916 run osmo-stp_10.42.42.4(pid=2009): Launched 09:46:24.773620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:25.238589 run create_hlr_db(pid=2010): Launched 09:46:26.407190 run create_hlr_db(pid=2010): Terminated: ok {rc=0} 09:46:26.722398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2012): Launched 09:46:27.021306 run osmo-hlr_10.42.42.2(pid=2013): Launched 09:46:27.135953 run osmo-msc_10.42.42.5: Starting osmo-msc 09:46:27.684850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2015): Launched 09:46:27.985443 run osmo-msc_10.42.42.5(pid=2016): Launched 09:46:28.154268 run osmo-hlr_10.42.42.2(pid=2013): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2013)] 09:46:28.287262 run osmo-hlr_10.42.42.2(pid=2013): stdout: | (launched: 2022-12-13_09:46:26.966939) 09:46:28.425688 run osmo-hlr_10.42.42.2(pid=2013): stderr: | 20221213094627139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094627139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094627139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094627140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094627140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094627140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094627151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094627160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094627161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094627161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:28.561550 run osmo-hlr_10.42.42.2(pid=2013): stdout: | (launched: 2022-12-13_09:46:26.966939) 09:46:28.690152 run osmo-hlr_10.42.42.2(pid=2013): stderr: | 20221213094627139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094627139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094627139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094627140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094627140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094627140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094627151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094627160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094627161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094627161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:28.843659 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=2013): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2013) [trial-2387↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2013)] [trial-2387↪smpp↪esme_connect_policy_closed.py:31] 09:46:28.852788 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec) 09:46:28.880129 run osmo-msc_10.42.42.5(pid=2016): ERR: Terminated: ERROR {rc=9} [trial-2387↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2016)] 09:46:28.930891 run osmo-msc_10.42.42.5(pid=2016): stdout: | (launched: 2022-12-13_09:46:27.929964) 09:46:28.983131 run osmo-msc_10.42.42.5(pid=2016): stderr: | 20221213094628244 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213094628244 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213094628245 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094628245 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213094628245 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213094628245 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213094628245 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213094628245 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213094628245 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:46:29.035728 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2008): Terminating (SIGTERM) 09:46:29.077429 run osmo-stp_10.42.42.4(pid=2009): Terminating (SIGTERM) 09:46:29.119284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2012): Terminating (SIGTERM) 09:46:29.162536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2015): Terminating (SIGTERM) 09:46:29.206199 --- ParallelTerminationStrategy: PID 2008 died... 09:46:29.226913 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2008): Terminated: ok {rc=0} 09:46:29.275015 --- ParallelTerminationStrategy: PID 2009 died... 09:46:29.295121 run osmo-stp_10.42.42.4(pid=2009): Terminated: ok {rc=0} 09:46:29.342139 --- ParallelTerminationStrategy: PID 2012 died... 09:46:29.362211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2012): Terminated: ok {rc=0} 09:46:29.408383 --- ParallelTerminationStrategy: PID 2015 died... 09:46:29.428477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2015): Terminated: ok {rc=0} ---------------------------------------------- trial-2387 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:46:29.479864 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:29.491369 tst smpp: Using 1 x bts (candidates: 1) 09:46:29.526730 tst esme_ms_sms_storeforward.py: using LAC 33125 09:46:29.655881 tst esme_ms_sms_storeforward.py: using RAC 230 09:46:29.785229 tst esme_ms_sms_storeforward.py: using CellId 33125 09:46:29.910941 tst esme_ms_sms_storeforward.py: using BVCI 33126 09:46:30.027845 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:30.038733 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:30.049500 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:30.060171 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:30.071494 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:30.082826 tst smpp: Using 1 x modem (candidates: 1) 09:46:30.209004 tst esme_ms_sms_storeforward.py: using MSISDN 8096 09:46:30.326354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:30.824003 run create_hlr_db(pid=2019): Launched 09:46:32.060636 run create_hlr_db(pid=2019): Terminated: ok {rc=0} 09:46:32.405116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Launched 09:46:32.724906 run osmo-hlr_10.42.42.2(pid=2022): Launched 09:46:32.847585 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:33.404189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Launched 09:46:33.725039 run osmo-stp_10.42.42.5(pid=2025): Launched 09:46:33.847254 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:34.426893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2027): Launched 09:46:34.746881 run osmo-msc_10.42.42.6(pid=2028): Launched 09:46:34.925743 run osmo-stp_10.42.42.5(pid=2025): ERR: Terminated: ERROR {rc=1} [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)] 09:46:35.061493 run osmo-stp_10.42.42.5(pid=2025): stdout: | (launched: 2022-12-13_09:46:33.666898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:35.197848 run osmo-stp_10.42.42.5(pid=2025): stderr: | 20221213094633859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094633859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094633859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094633860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094633862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094633862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094633862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:35.333805 run osmo-stp_10.42.42.5(pid=2025): stdout: | (launched: 2022-12-13_09:46:33.666898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:35.461330 run osmo-stp_10.42.42.5(pid=2025): stderr: | 20221213094633859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094633859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094633859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094633860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094633862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094633862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094633862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:35.613793 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=2025): Process ended prematurely: osmo-stp_10.42.42.5(pid=2025) [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)] [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30] 09:46:35.622516 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 09:46:35.649376 run osmo-hlr_10.42.42.2(pid=2022): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2022)] 09:46:35.700008 run osmo-hlr_10.42.42.2(pid=2022): stdout: | (launched: 2022-12-13_09:46:32.667052) 09:46:35.751459 run osmo-hlr_10.42.42.2(pid=2022): stderr: | 20221213094632865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094632865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094632865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094632865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094632865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094632865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094632891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094632900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094632901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094632901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:35.822833 run osmo-msc_10.42.42.6(pid=2028): ERR: Terminated: ERROR {rc=2} [trial-2387↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2028)] 09:46:35.872480 run osmo-msc_10.42.42.6(pid=2028): stdout: | (launched: 2022-12-13_09:46:34.688725) 09:46:35.923832 run osmo-msc_10.42.42.6(pid=2028): stderr: | 20221213094635011 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094635011 DLGLOBAL DEBUG validating counter group 0x7f6b41e42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094635011 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094635011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094635011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094635012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094635013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094635014 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094635014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094635014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:35.975721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Terminating (SIGTERM) 09:46:36.016916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Terminating (SIGTERM) 09:46:36.058743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2027): Terminating (SIGTERM) 09:46:36.101068 --- ParallelTerminationStrategy: PID 2021 died... 09:46:36.120800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Terminated: ok {rc=0} 09:46:36.166268 --- ParallelTerminationStrategy: PID 2024 died... 09:46:36.185534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Terminated: ok {rc=0} 09:46:36.230833 --- ParallelTerminationStrategy: PID 2027 died... 09:46:36.250073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2027): Terminated: ok {rc=0} 09:46:36.336212 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:46:37.423682 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:37.434803 tst smpp: Using 1 x bts (candidates: 1) 09:46:37.470598 tst esme_ms_sms_transaction.py: using LAC 33126 09:46:37.590101 tst esme_ms_sms_transaction.py: using RAC 231 09:46:37.707799 tst esme_ms_sms_transaction.py: using CellId 33126 09:46:37.826844 tst esme_ms_sms_transaction.py: using BVCI 33127 09:46:37.936836 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:37.947290 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:37.957752 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:37.968037 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:37.978461 tst smpp: Using 1 x ip_address (candidates: 6) 09:46:37.989405 tst smpp: Using 1 x modem (candidates: 1) 09:46:38.121670 tst esme_ms_sms_transaction.py: using MSISDN 8097 09:46:38.231932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:38.696380 run create_hlr_db(pid=2030): Launched 09:46:38.810909 bus /sierra_2: Setting Powered False 09:46:39.870883 run create_hlr_db(pid=2030): Terminated: ok {rc=0} 09:46:40.309186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Launched 09:46:40.629342 run osmo-hlr_10.42.42.2(pid=2033): Launched 09:46:40.753093 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:41.304420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Launched 09:46:41.624466 run osmo-stp_10.42.42.5(pid=2036): Launched 09:46:41.747301 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:42.325770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2038): Launched 09:46:42.644540 run osmo-msc_10.42.42.6(pid=2039): Launched 09:46:42.823246 run osmo-stp_10.42.42.5(pid=2036): ERR: Terminated: ERROR {rc=1} [trial-2387↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] 09:46:42.958238 run osmo-stp_10.42.42.5(pid=2036): stdout: | (launched: 2022-12-13_09:46:41.566433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:43.095015 run osmo-stp_10.42.42.5(pid=2036): stderr: | 20221213094641759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094641760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094641760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094641760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094641761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094641761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094641761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:43.229680 run osmo-stp_10.42.42.5(pid=2036): stdout: | (launched: 2022-12-13_09:46:41.566433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:43.358601 run osmo-stp_10.42.42.5(pid=2036): stderr: | 20221213094641759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094641760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094641760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094641760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094641761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094641761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094641761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:43.511417 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2387↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] [trial-2387↪smpp↪esme_ms_sms_transaction.py:28] 09:46:43.520336 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 09:46:43.547794 run osmo-hlr_10.42.42.2(pid=2033): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2033)] 09:46:43.597638 run osmo-hlr_10.42.42.2(pid=2033): stdout: | (launched: 2022-12-13_09:46:40.571075) 09:46:43.649456 run osmo-hlr_10.42.42.2(pid=2033): stderr: | 20221213094640770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094640770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094640770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094640770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094640770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094640770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094640782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094640791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094640791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094640791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:43.721239 run osmo-msc_10.42.42.6(pid=2039): ERR: Terminated: ERROR {rc=2} [trial-2387↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2039)] 09:46:43.770846 run osmo-msc_10.42.42.6(pid=2039): stdout: | (launched: 2022-12-13_09:46:42.586782) 09:46:43.822964 run osmo-msc_10.42.42.6(pid=2039): stderr: | 20221213094642907 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094642907 DLGLOBAL DEBUG validating counter group 0x7f02c835dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094642907 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094642907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094642908 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094642908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094642910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094642910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094642910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094642910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:43.874922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminating (SIGTERM) 09:46:43.916593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminating (SIGTERM) 09:46:43.958260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2038): Terminating (SIGTERM) 09:46:44.000485 --- ParallelTerminationStrategy: PID 2032 died... 09:46:44.020677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminated: ok {rc=0} 09:46:44.067684 --- ParallelTerminationStrategy: PID 2035 died... 09:46:44.087367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminated: ok {rc=0} 09:46:44.133677 --- ParallelTerminationStrategy: PID 2038 died... 09:46:44.153373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2038): Terminated: ok {rc=0} 09:46:44.241060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 encryption --------------------------------------------------------------------- 09:46:45.428444 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:45.431385 tst encryption: Verifying 1 x bts (candidates: 11) 09:46:45.451804 tst encryption: Verifying 6 x ip_address (candidates: 9) 09:46:45.478785 tst encryption: Verifying 1 x modem (candidates: 12) 09:46:45.513707 tst encryption: Reserving 1 x bts (candidates: 11) 09:46:45.534866 tst encryption: Reserving 6 x ip_address (candidates: 9) 09:46:45.561566 tst encryption: Reserving 1 x modem (candidates: 12) 09:46:46.088573 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2387 encryption register_a5_0_authopt.py ---------------------------------------------- 09:46:46.144672 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:46.156514 tst encryption: Using 1 x bts (candidates: 1) 09:46:46.193134 tst register_a5_0_authopt.py: using LAC 33127 09:46:46.324324 tst register_a5_0_authopt.py: using RAC 232 09:46:46.473934 tst register_a5_0_authopt.py: using CellId 33127 09:46:46.636168 tst register_a5_0_authopt.py: using BVCI 33128 09:46:46.760142 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:46.772278 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:46.784748 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:46.796635 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:46.809406 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:46.821898 tst encryption: Using 1 x modem (candidates: 1) 09:46:46.945336 tst register_a5_0_authopt.py:8: start network... 09:46:47.169650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:47.674177 run create_hlr_db(pid=2044): Launched 09:46:47.806119 bus /sierra_2: Setting Powered False 09:46:48.870631 run create_hlr_db(pid=2044): Terminated: ok {rc=0} 09:46:49.318796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2046): Launched 09:46:49.642829 run osmo-hlr_10.42.42.2(pid=2047): Launched 09:46:49.765662 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:50.327465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2049): Launched 09:46:50.650324 run osmo-stp_10.42.42.5(pid=2050): Launched 09:46:50.773394 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:51.355971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2052): Launched 09:46:51.679129 run osmo-msc_10.42.42.6(pid=2053): Launched 09:46:51.860157 run osmo-stp_10.42.42.5(pid=2050): ERR: Terminated: ERROR {rc=1} [trial-2387↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2050)] 09:46:51.996344 run osmo-stp_10.42.42.5(pid=2050): stdout: | (launched: 2022-12-13_09:46:50.591756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:52.133287 run osmo-stp_10.42.42.5(pid=2050): stderr: | 20221213094650784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094650784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094650784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094650785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094650785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094650785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094650785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:52.268857 run osmo-stp_10.42.42.5(pid=2050): stdout: | (launched: 2022-12-13_09:46:50.591756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:52.398775 run osmo-stp_10.42.42.5(pid=2050): stderr: | 20221213094650784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094650784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094650784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094650785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094650785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094650785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094650785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:52.553283 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2050): Process ended prematurely: osmo-stp_10.42.42.5(pid=2050) [trial-2387↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2050)] [trial-2387↪encryption↪register_a5_0_authopt.py:8] 09:46:52.562661 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 09:46:52.590102 run osmo-hlr_10.42.42.2(pid=2047): ERR: Terminated: ERROR {rc=237} [trial-2387↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2047)] 09:46:52.639992 run osmo-hlr_10.42.42.2(pid=2047): stdout: | (launched: 2022-12-13_09:46:49.584374) 09:46:52.691518 run osmo-hlr_10.42.42.2(pid=2047): stderr: | 20221213094649783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094649783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094649783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094649783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094649783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094649783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094649796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094649804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094649804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094649804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:52.763447 run osmo-msc_10.42.42.6(pid=2053): ERR: Terminated: ERROR {rc=2} [trial-2387↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2053)] 09:46:52.813093 run osmo-msc_10.42.42.6(pid=2053): stdout: | (launched: 2022-12-13_09:46:51.620520) 09:46:52.864452 run osmo-msc_10.42.42.6(pid=2053): stderr: | 20221213094651944 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094651944 DLGLOBAL DEBUG validating counter group 0x7f2d1264fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094651944 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094651944 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094651944 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094651945 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094651946 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094651947 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094651947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094651947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:52.916308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2046): Terminating (SIGTERM) 09:46:52.958063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2049): Terminating (SIGTERM) 09:46:52.999817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2052): Terminating (SIGTERM) 09:46:53.041795 --- ParallelTerminationStrategy: PID 2046 died... 09:46:53.061628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2046): Terminated: ok {rc=0} 09:46:53.108047 --- ParallelTerminationStrategy: PID 2049 died... 09:46:53.127620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2049): Terminated: ok {rc=0} 09:46:53.173719 --- ParallelTerminationStrategy: PID 2052 died... 09:46:53.193279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2052): Terminated: ok {rc=0} 09:46:53.280053 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 encryption register_a5_0_authreq.py ---------------------------------------------- 09:46:54.428260 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:54.439354 tst encryption: Using 1 x bts (candidates: 1) 09:46:54.474962 tst register_a5_0_authreq.py: using LAC 33128 09:46:54.596191 tst register_a5_0_authreq.py: using RAC 233 09:46:54.714297 tst register_a5_0_authreq.py: using CellId 33128 09:46:54.834172 tst register_a5_0_authreq.py: using BVCI 33129 09:46:54.945860 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:54.956328 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:54.966790 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:54.976996 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:54.987293 tst encryption: Using 1 x ip_address (candidates: 6) 09:46:54.997875 tst encryption: Using 1 x modem (candidates: 1) 09:46:55.115826 tst register_a5_0_authreq.py:8: start network... 09:46:55.336788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:55.837943 run create_hlr_db(pid=2056): Launched 09:46:55.969236 bus /sierra_2: Setting Powered False 09:46:57.033308 run create_hlr_db(pid=2056): Terminated: ok {rc=0} 09:46:57.464521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2058): Launched 09:46:57.789113 run osmo-hlr_10.42.42.2(pid=2059): Launched 09:46:57.911908 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:58.467419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2061): Launched 09:46:58.789506 run osmo-stp_10.42.42.5(pid=2062): Launched 09:46:58.913205 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:59.498222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2064): Launched 09:46:59.822510 run osmo-msc_10.42.42.6(pid=2065): Launched 09:47:00.003087 run osmo-stp_10.42.42.5(pid=2062): ERR: Terminated: ERROR {rc=1} [trial-2387↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2062)] 09:47:00.139093 run osmo-stp_10.42.42.5(pid=2062): stdout: | (launched: 2022-12-13_09:46:58.731175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:00.275941 run osmo-stp_10.42.42.5(pid=2062): stderr: | 20221213094658925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094658925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094658925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094658926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094658926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094658926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094658926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:00.412348 run osmo-stp_10.42.42.5(pid=2062): stdout: | (launched: 2022-12-13_09:46:58.731175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:00.541513 run osmo-stp_10.42.42.5(pid=2062): stderr: | 20221213094658925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094658925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094658925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094658926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094658926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094658926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094658926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:00.695775 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2062): Process ended prematurely: osmo-stp_10.42.42.5(pid=2062) [trial-2387↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2062)] [trial-2387↪encryption↪register_a5_0_authreq.py:8] 09:47:00.705196 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 09:47:00.732498 run osmo-hlr_10.42.42.2(pid=2059): ERR: Terminated: ERROR {rc=237} [trial-2387↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2059)] 09:47:00.782428 run osmo-hlr_10.42.42.2(pid=2059): stdout: | (launched: 2022-12-13_09:46:57.730675) 09:47:00.834138 run osmo-hlr_10.42.42.2(pid=2059): stderr: | 20221213094657932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094657932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094657932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094657932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094657932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094657932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094657957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094657967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094657967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094657967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:00.922180 run osmo-msc_10.42.42.6(pid=2065): ERR: Terminated: ERROR {rc=2} [trial-2387↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2065)] 09:47:00.972728 run osmo-msc_10.42.42.6(pid=2065): stdout: | (launched: 2022-12-13_09:46:59.763757) 09:47:01.026149 run osmo-msc_10.42.42.6(pid=2065): stderr: | 20221213094700088 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094700088 DLGLOBAL DEBUG validating counter group 0x7fdab9507c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094700088 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094700088 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094700088 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094700088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094700090 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094700091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094700091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094700091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:01.079581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2058): Terminating (SIGTERM) 09:47:01.122747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2061): Terminating (SIGTERM) 09:47:01.167516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2064): Terminating (SIGTERM) 09:47:01.211898 --- ParallelTerminationStrategy: PID 2058 died... 09:47:01.232179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2058): Terminated: ok {rc=0} 09:47:01.279578 --- ParallelTerminationStrategy: PID 2061 died... 09:47:01.300702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2061): Terminated: ok {rc=0} 09:47:01.348152 --- ParallelTerminationStrategy: PID 2064 died... 09:47:01.368333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2064): Terminated: ok {rc=0} 09:47:01.457899 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 encryption register_a5_1_authreq.py ---------------------------------------------- 09:47:02.608274 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:02.619748 tst encryption: Using 1 x bts (candidates: 1) 09:47:02.657068 tst register_a5_1_authreq.py: using LAC 33129 09:47:02.783940 tst register_a5_1_authreq.py: using RAC 234 09:47:02.911090 tst register_a5_1_authreq.py: using CellId 33129 09:47:03.038274 tst register_a5_1_authreq.py: using BVCI 33130 09:47:03.157465 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:03.168878 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:03.180244 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:03.191481 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:03.202986 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:03.214459 tst encryption: Using 1 x modem (candidates: 1) 09:47:03.331760 tst register_a5_1_authreq.py:8: start network... 09:47:03.551523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:04.052672 run create_hlr_db(pid=2067): Launched 09:47:04.182844 bus /sierra_2: Setting Powered False 09:47:05.243407 run create_hlr_db(pid=2067): Terminated: ok {rc=0} 09:47:05.665930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2069): Launched 09:47:05.969531 run osmo-hlr_10.42.42.2(pid=2070): Launched 09:47:06.086296 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:06.614421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2072): Launched 09:47:06.917183 run osmo-stp_10.42.42.5(pid=2073): Launched 09:47:07.034397 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:07.582395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2075): Launched 09:47:07.885646 run osmo-msc_10.42.42.6(pid=2076): Launched 09:47:08.057048 run osmo-stp_10.42.42.5(pid=2073): ERR: Terminated: ERROR {rc=1} [trial-2387↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2073)] 09:47:08.185988 run osmo-stp_10.42.42.5(pid=2073): stdout: | (launched: 2022-12-13_09:47:06.861917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:08.314730 run osmo-stp_10.42.42.5(pid=2073): stderr: | 20221213094707035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094707035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094707035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094707036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094707036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094707036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094707036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:08.440789 run osmo-stp_10.42.42.5(pid=2073): stdout: | (launched: 2022-12-13_09:47:06.861917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:08.562565 run osmo-stp_10.42.42.5(pid=2073): stderr: | 20221213094707035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094707035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094707035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094707036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094707036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094707036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094707036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:08.707687 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2073): Process ended prematurely: osmo-stp_10.42.42.5(pid=2073) [trial-2387↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2073)] [trial-2387↪encryption↪register_a5_1_authreq.py:8] 09:47:08.716604 tst register_a5_1_authreq.py:8: Test FAILED (6.1 sec) 09:47:08.742926 run osmo-hlr_10.42.42.2(pid=2070): ERR: Terminated: ERROR {rc=237} [trial-2387↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2070)] 09:47:08.790903 run osmo-hlr_10.42.42.2(pid=2070): stdout: | (launched: 2022-12-13_09:47:05.914056) 09:47:08.840463 run osmo-hlr_10.42.42.2(pid=2070): stderr: | 20221213094706092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094706092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094706092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094706092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094706092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094706092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094706105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094706113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094706113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094706113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:08.910285 run osmo-msc_10.42.42.6(pid=2076): ERR: Terminated: ERROR {rc=2} [trial-2387↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2076)] 09:47:08.958541 run osmo-msc_10.42.42.6(pid=2076): stdout: | (launched: 2022-12-13_09:47:07.830330) 09:47:09.008340 run osmo-msc_10.42.42.6(pid=2076): stderr: | 20221213094708101 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094708102 DLGLOBAL DEBUG validating counter group 0x7f3ce19dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094708102 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094708102 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094708102 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094708102 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094708104 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094708104 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094708104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094708104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:09.058326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2069): Terminating (SIGTERM) 09:47:09.098265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2072): Terminating (SIGTERM) 09:47:09.138290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2075): Terminating (SIGTERM) 09:47:09.178308 --- ParallelTerminationStrategy: PID 2069 died... 09:47:09.197892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2069): Terminated: ok {rc=0} 09:47:09.242169 --- ParallelTerminationStrategy: PID 2072 died... 09:47:09.260849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2072): Terminated: ok {rc=0} 09:47:09.305442 --- ParallelTerminationStrategy: PID 2075 died... 09:47:09.324446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2075): Terminated: ok {rc=0} 09:47:09.408230 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2387 encryption register_a5_3_authreq.py ---------------------------------------------- 09:47:10.558292 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:10.569725 tst encryption: Using 1 x bts (candidates: 1) 09:47:10.606400 tst register_a5_3_authreq.py: using LAC 33130 09:47:10.735257 tst register_a5_3_authreq.py: using RAC 235 09:47:10.862759 tst register_a5_3_authreq.py: using CellId 33130 09:47:10.990467 tst register_a5_3_authreq.py: using BVCI 33131 09:47:11.108291 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:11.119295 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:11.130112 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:11.140784 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:11.151613 tst encryption: Using 1 x ip_address (candidates: 6) 09:47:11.162351 tst encryption: Using 1 x modem (candidates: 1) 09:47:11.291369 tst register_a5_3_authreq.py:8: start network... 09:47:11.510535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:12.012256 run create_hlr_db(pid=2078): Launched 09:47:12.144894 bus /sierra_2: Setting Powered False 09:47:13.208658 run create_hlr_db(pid=2078): Terminated: ok {rc=0} 09:47:13.641341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2080): Launched 09:47:13.944512 run osmo-hlr_10.42.42.2(pid=2081): Launched 09:47:14.061096 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:14.598176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2083): Launched 09:47:14.900396 run osmo-stp_10.42.42.5(pid=2084): Launched 09:47:15.016203 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:15.562675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2086): Launched 09:47:15.889692 run osmo-msc_10.42.42.6(pid=2087): Launched 09:47:16.204276 run osmo-stp_10.42.42.5(pid=2084): ERR: Terminated: ERROR {rc=1} [trial-2387↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2084)] 09:47:16.556733 run osmo-stp_10.42.42.5(pid=2084): stdout: | (launched: 2022-12-13_09:47:14.845455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:16.698037 run osmo-stp_10.42.42.5(pid=2084): stderr: | 20221213094715016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094715016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094715016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094715016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094715019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094715019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094715019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:16.837336 run osmo-stp_10.42.42.5(pid=2084): stdout: | (launched: 2022-12-13_09:47:14.845455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:16.970976 run osmo-stp_10.42.42.5(pid=2084): stderr: | 20221213094715016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094715016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094715016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094715016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094715019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094715019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094715019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:17.131786 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2084): Process ended prematurely: osmo-stp_10.42.42.5(pid=2084) [trial-2387↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2084)] [trial-2387↪encryption↪register_a5_3_authreq.py:8] 09:47:17.141785 tst register_a5_3_authreq.py:8: Test FAILED (6.6 sec) 09:47:17.170325 run osmo-hlr_10.42.42.2(pid=2081): ERR: Terminated: ERROR {rc=237} [trial-2387↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2081)] 09:47:17.222577 run osmo-hlr_10.42.42.2(pid=2081): stdout: | (launched: 2022-12-13_09:47:13.889790) 09:47:17.275060 run osmo-hlr_10.42.42.2(pid=2081): stderr: | 20221213094714067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094714067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094714067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094714067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094714067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094714067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094714079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094714087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094714087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094714088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:17.347651 run osmo-msc_10.42.42.6(pid=2087): ERR: Terminated: ERROR {rc=2} [trial-2387↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2087)] 09:47:17.397578 run osmo-msc_10.42.42.6(pid=2087): stdout: | (launched: 2022-12-13_09:47:15.810344) 09:47:17.449954 run osmo-msc_10.42.42.6(pid=2087): stderr: | 20221213094716284 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094716285 DLGLOBAL DEBUG validating counter group 0x7f1eeeca3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094716285 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094716285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094716285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094716285 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094716292 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094716293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094716293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094716293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:17.501784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2080): Terminating (SIGTERM) 09:47:17.543398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2083): Terminating (SIGTERM) 09:47:17.585307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2086): Terminating (SIGTERM) 09:47:17.627425 --- ParallelTerminationStrategy: PID 2080 died... 09:47:17.647229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2080): Terminated: ok {rc=0} 09:47:17.693650 --- ParallelTerminationStrategy: PID 2083 died... 09:47:17.713280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2083): Terminated: ok {rc=0} 09:47:17.759299 --- ParallelTerminationStrategy: PID 2086 died... 09:47:17.778784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2086): Terminated: ok {rc=0} 09:47:17.866266 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 09:47:19.074669 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:19.079910 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 09:47:19.098269 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 09:47:19.126830 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 09:47:19.154906 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 09:47:19.173397 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 09:47:19.200069 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 09:47:19.710699 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 09:47:19.716255 tst handover.py:11: TEST_CONFIG: {} 09:47:19.920001 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:47:19.936069 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:47:19.958490 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:47:20.012728 tst handover.py: using MSISDN 8098 09:47:20.131856 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8098', subscriber_id=0} 09:47:20.244736 run srsepc_10.42.42.118: Starting srsepc 09:47:22.138401 run rm-remote-dir(pid=2092): Launched 09:47:22.266415 bus /sierra_2: Setting Powered False 09:47:23.335066 run rm-remote-dir(pid=2092): Terminated: ok {rc=0} 09:47:23.781036 run mk-remote-dir(pid=2093): Launched 09:47:24.959190 run mk-remote-dir(pid=2093): Terminated: ok {rc=0} 09:47:25.241334 run scp-inst-to-remote(pid=2094): Launched 09:47:27.422705 run scp-inst-to-remote(pid=2094): Terminated: ok {rc=0} 09:47:27.774583 run rm-remote-dir(pid=2096): Launched 09:47:28.960599 run rm-remote-dir(pid=2096): Terminated: ok {rc=0} 09:47:29.313428 run mk-remote-dir(pid=2097): Launched 09:47:30.502272 run mk-remote-dir(pid=2097): Terminated: ok {rc=0} 09:47:30.802570 run scp-cfg-to-remote(pid=2098): Launched 09:47:31.988593 run scp-cfg-to-remote(pid=2098): Terminated: ok {rc=0} 09:47:32.301250 run scp-db-to-remote(pid=2100): Launched 09:47:33.487293 run scp-db-to-remote(pid=2100): Terminated: ok {rc=0} 09:47:33.617532 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:47:33.921167 run patchelf(pid=2102): Launched 09:47:35.096830 run patchelf(pid=2102): Terminated: ok {rc=0} 09:47:35.225779 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:47:35.528810 run setcap-netadm(pid=2103): Launched 09:47:36.704847 run setcap-netadm(pid=2103): Terminated: ok {rc=0} 09:47:37.023453 run srsepc(pid=2104): Launched 09:47:37.137381 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:47:38.228878 run rm-remote-dir(pid=2105): Launched 09:47:38.404085 run srsepc(pid=2104): ERR: Terminated: ERROR {rc=127} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2104)] 09:47:38.538039 run srsepc(pid=2104): stdout: | (launched: 2022-12-13_09:47:36.967781) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:47:38.672087 run srsepc(pid=2104): stderr: | (launched: 2022-12-13_09:47:37.012716) | Connection to 10.42.42.116 closed. 09:47:38.804823 run srsepc(pid=2104): stdout: | (launched: 2022-12-13_09:47:36.967781) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:47:38.932122 run srsepc(pid=2104): stderr: | (launched: 2022-12-13_09:47:37.012716) | Connection to 10.42.42.116 closed. 09:47:39.082870 run rm-remote-dir(pid=2105): Terminating (SIGINT) 09:47:39.257953 run rm-remote-dir(pid=2105): Terminated: ok {rc=0} 09:47:39.384731 tst handover.py:37: ERR: Error: srsepc(pid=2104): Process ended prematurely: srsepc(pid=2104) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2104)] [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 09:47:39.394391 tst handover.py:37: Test FAILED (19.7 sec) 09:47:39.469705 run scp-back-log(pid=2106): Launched 09:47:40.545734 run scp-back-log(pid=2106): ERR: Terminated: ERROR {rc=1} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2106)] 09:47:40.605562 run scp-back-log(pid=2106): stdout: | (launched: 2022-12-13_09:47:39.439888) 09:47:40.667125 run scp-back-log(pid=2106): stderr: | (launched: 2022-12-13_09:47:39.459372) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:47:40.736330 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2106): launch_sync(): local process exited with status 1 [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2106)]') ---------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 09:47:40.780292 tst iperf3_bidir.py:13: Number of physical ue: 1 09:47:40.982507 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:47:41.024663 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 09:47:41.241949 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:47:41.258546 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:47:41.291367 tst iperf3_bidir.py: using MSISDN 8099 09:47:41.400870 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8099', subscriber_id=0} 09:47:41.506633 run srsepc_10.42.42.118: Starting srsepc 09:47:42.125448 run rm-remote-dir(pid=2108): Launched 09:47:43.302977 run rm-remote-dir(pid=2108): Terminated: ok {rc=0} 09:47:43.633091 run mk-remote-dir(pid=2109): Launched 09:47:44.809847 run mk-remote-dir(pid=2109): Terminated: ok {rc=0} 09:47:45.090492 run scp-inst-to-remote(pid=2110): Launched 09:47:47.268602 run scp-inst-to-remote(pid=2110): Terminated: ok {rc=0} 09:47:47.636014 run rm-remote-dir(pid=2112): Launched 09:47:48.823534 run rm-remote-dir(pid=2112): Terminated: ok {rc=0} 09:47:49.175945 run mk-remote-dir(pid=2113): Launched 09:47:50.363471 run mk-remote-dir(pid=2113): Terminated: ok {rc=0} 09:47:50.663622 run scp-cfg-to-remote(pid=2114): Launched 09:47:51.847959 run scp-cfg-to-remote(pid=2114): Terminated: ok {rc=0} 09:47:52.146883 run scp-db-to-remote(pid=2116): Launched 09:47:53.334023 run scp-db-to-remote(pid=2116): Terminated: ok {rc=0} 09:47:53.473432 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:47:53.797542 run patchelf(pid=2118): Launched 09:47:54.982484 run patchelf(pid=2118): Terminated: ok {rc=0} 09:47:55.121256 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:47:55.445686 run setcap-netadm(pid=2119): Launched 09:47:56.629461 run setcap-netadm(pid=2119): Terminated: ok {rc=0} 09:47:56.968911 run srsepc(pid=2120): Launched 09:47:57.089262 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:47:58.254200 run rm-remote-dir(pid=2121): Launched 09:47:58.439097 run srsepc(pid=2120): ERR: Terminated: ERROR {rc=127} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2120)] 09:47:58.580622 run srsepc(pid=2120): stdout: | (launched: 2022-12-13_09:47:56.910642) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:47:58.723617 run srsepc(pid=2120): stderr: | (launched: 2022-12-13_09:47:56.958685) | Connection to 10.42.42.116 closed. 09:47:58.866184 run srsepc(pid=2120): stdout: | (launched: 2022-12-13_09:47:56.910642) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:47:59.003015 run srsepc(pid=2120): stderr: | (launched: 2022-12-13_09:47:56.958685) | Connection to 10.42.42.116 closed. 09:47:59.165105 run rm-remote-dir(pid=2121): Terminating (SIGINT) 09:47:59.353258 run rm-remote-dir(pid=2121): Terminated: ok {rc=0} 09:47:59.489111 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=2120): Process ended prematurely: srsepc(pid=2120) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2120)] [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 09:47:59.499906 tst iperf3_bidir.py:42: Test FAILED (18.7 sec) 09:47:59.580747 run scp-back-log(pid=2122): Launched 09:48:00.661816 run scp-back-log(pid=2122): ERR: Terminated: ERROR {rc=1} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2122)] 09:48:00.726471 run scp-back-log(pid=2122): stdout: | (launched: 2022-12-13_09:47:59.549539) 09:48:00.792315 run scp-back-log(pid=2122): stderr: | (launched: 2022-12-13_09:47:59.570206) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:48:00.885036 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2122): launch_sync(): local process exited with status 1 [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2122)]') ---------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 09:48:00.940826 tst iperf3_dl.py:13: Number of physical ue: 1 09:48:01.199728 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:48:01.251802 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 09:48:01.472775 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:48:01.490218 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:48:01.524383 tst iperf3_dl.py: using MSISDN 8100 09:48:01.649844 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8100', subscriber_id=0} 09:48:01.767715 run srsepc_10.42.42.118: Starting srsepc 09:48:02.438440 run rm-remote-dir(pid=2124): Launched 09:48:03.626053 run rm-remote-dir(pid=2124): Terminated: ok {rc=0} 09:48:03.978336 run mk-remote-dir(pid=2125): Launched 09:48:05.165453 run mk-remote-dir(pid=2125): Terminated: ok {rc=0} 09:48:05.466329 run scp-inst-to-remote(pid=2126): Launched 09:48:07.652023 run scp-inst-to-remote(pid=2126): Terminated: ok {rc=0} 09:48:08.004090 run rm-remote-dir(pid=2128): Launched 09:48:09.190445 run rm-remote-dir(pid=2128): Terminated: ok {rc=0} 09:48:09.543665 run mk-remote-dir(pid=2129): Launched 09:48:10.731107 run mk-remote-dir(pid=2129): Terminated: ok {rc=0} 09:48:11.031390 run scp-cfg-to-remote(pid=2130): Launched 09:48:12.216247 run scp-cfg-to-remote(pid=2130): Terminated: ok {rc=0} 09:48:12.515385 run scp-db-to-remote(pid=2132): Launched 09:48:13.701295 run scp-db-to-remote(pid=2132): Terminated: ok {rc=0} 09:48:13.839661 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:48:14.164480 run patchelf(pid=2134): Launched 09:48:15.349162 run patchelf(pid=2134): Terminated: ok {rc=0} 09:48:15.487911 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:48:15.811957 run setcap-netadm(pid=2135): Launched 09:48:17.014077 run setcap-netadm(pid=2135): Terminated: ok {rc=0} 09:48:17.339380 run srsepc(pid=2136): Launched 09:48:17.453736 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:48:18.551220 run rm-remote-dir(pid=2137): Launched 09:48:18.727243 run srsepc(pid=2136): ERR: Terminated: ERROR {rc=127} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2136)] 09:48:18.861402 run srsepc(pid=2136): stdout: | (launched: 2022-12-13_09:48:17.284137) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:48:18.994977 run srsepc(pid=2136): stderr: | (launched: 2022-12-13_09:48:17.329403) | Connection to 10.42.42.116 closed. 09:48:19.128504 run srsepc(pid=2136): stdout: | (launched: 2022-12-13_09:48:17.284137) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:48:19.255729 run srsepc(pid=2136): stderr: | (launched: 2022-12-13_09:48:17.329403) | Connection to 10.42.42.116 closed. 09:48:19.406966 run rm-remote-dir(pid=2137): Terminating (SIGINT) 09:48:19.582236 run rm-remote-dir(pid=2137): Terminated: ok {rc=0} 09:48:19.708415 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=2136): Process ended prematurely: srsepc(pid=2136) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2136)] [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 09:48:19.718235 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 09:48:19.793329 run scp-back-log(pid=2138): Launched 09:48:20.869340 run scp-back-log(pid=2138): ERR: Terminated: ERROR {rc=1} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2138)] 09:48:20.928935 run scp-back-log(pid=2138): stdout: | (launched: 2022-12-13_09:48:19.763830) 09:48:20.990395 run scp-back-log(pid=2138): stderr: | (launched: 2022-12-13_09:48:19.783327) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:48:21.059030 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2138): launch_sync(): local process exited with status 1 [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2138)]') ---------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 09:48:21.102951 tst iperf3_ul.py:13: Number of physical ue: 1 09:48:21.305874 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:48:21.347438 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 09:48:21.549280 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:48:21.564745 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:48:21.597083 tst iperf3_ul.py: using MSISDN 8101 09:48:21.708394 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8101', subscriber_id=0} 09:48:21.814064 run srsepc_10.42.42.118: Starting srsepc 09:48:22.433214 run rm-remote-dir(pid=2140): Launched 09:48:23.611097 run rm-remote-dir(pid=2140): Terminated: ok {rc=0} 09:48:23.942042 run mk-remote-dir(pid=2141): Launched 09:48:25.124041 run mk-remote-dir(pid=2141): Terminated: ok {rc=0} 09:48:25.424691 run scp-inst-to-remote(pid=2142): Launched 09:48:27.612606 run scp-inst-to-remote(pid=2142): Terminated: ok {rc=0} 09:48:27.963668 run rm-remote-dir(pid=2144): Launched 09:48:29.151376 run rm-remote-dir(pid=2144): Terminated: ok {rc=0} 09:48:29.505153 run mk-remote-dir(pid=2145): Launched 09:48:30.693531 run mk-remote-dir(pid=2145): Terminated: ok {rc=0} 09:48:31.025656 run scp-cfg-to-remote(pid=2146): Launched 09:48:32.246736 run scp-cfg-to-remote(pid=2146): Terminated: ok {rc=0} 09:48:32.531624 run scp-db-to-remote(pid=2148): Launched 09:48:33.710572 run scp-db-to-remote(pid=2148): Terminated: ok {rc=0} 09:48:33.840706 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:48:34.144309 run patchelf(pid=2150): Launched 09:48:35.320637 run patchelf(pid=2150): Terminated: ok {rc=0} 09:48:35.449904 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:48:35.752903 run setcap-netadm(pid=2151): Launched 09:48:36.928856 run setcap-netadm(pid=2151): Terminated: ok {rc=0} 09:48:37.247547 run srsepc(pid=2152): Launched 09:48:37.361923 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:48:38.459184 run rm-remote-dir(pid=2153): Launched 09:48:38.635093 run srsepc(pid=2152): ERR: Terminated: ERROR {rc=127} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2152)] 09:48:38.768911 run srsepc(pid=2152): stdout: | (launched: 2022-12-13_09:48:37.192127) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:48:38.902309 run srsepc(pid=2152): stderr: | (launched: 2022-12-13_09:48:37.237294) | Connection to 10.42.42.116 closed. 09:48:39.035354 run srsepc(pid=2152): stdout: | (launched: 2022-12-13_09:48:37.192127) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:48:39.163076 run srsepc(pid=2152): stderr: | (launched: 2022-12-13_09:48:37.237294) | Connection to 10.42.42.116 closed. 09:48:39.313858 run rm-remote-dir(pid=2153): Terminating (SIGINT) 09:48:39.488706 run rm-remote-dir(pid=2153): Terminated: ok {rc=0} 09:48:39.615750 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=2152): Process ended prematurely: srsepc(pid=2152) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2152)] [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 09:48:39.625692 tst iperf3_ul.py:42: Test FAILED (18.5 sec) 09:48:39.700490 run scp-back-log(pid=2154): Launched 09:48:40.776670 run scp-back-log(pid=2154): ERR: Terminated: ERROR {rc=1} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2154)] 09:48:40.836543 run scp-back-log(pid=2154): stdout: | (launched: 2022-12-13_09:48:39.670983) 09:48:40.898188 run scp-back-log(pid=2154): stderr: | (launched: 2022-12-13_09:48:39.690433) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:48:40.967547 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2154): launch_sync(): local process exited with status 1 [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2154)]') ---------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 09:48:41.012524 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:48:41.028882 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:48:41.051443 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:48:41.100812 tst ping.py: using MSISDN 8102 09:48:41.213896 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8102', subscriber_id=0} 09:48:41.319836 run srsepc_10.42.42.118: Starting srsepc 09:48:41.940864 run rm-remote-dir(pid=2156): Launched 09:48:43.118139 run rm-remote-dir(pid=2156): Terminated: ok {rc=0} 09:48:43.447828 run mk-remote-dir(pid=2157): Launched 09:48:44.626700 run mk-remote-dir(pid=2157): Terminated: ok {rc=0} 09:48:44.926076 run scp-inst-to-remote(pid=2158): Launched 09:48:47.115078 run scp-inst-to-remote(pid=2158): Terminated: ok {rc=0} 09:48:47.483802 run rm-remote-dir(pid=2160): Launched 09:48:48.685832 run rm-remote-dir(pid=2160): Terminated: ok {rc=0} 09:48:49.037533 run mk-remote-dir(pid=2161): Launched 09:48:50.224551 run mk-remote-dir(pid=2161): Terminated: ok {rc=0} 09:48:50.524655 run scp-cfg-to-remote(pid=2162): Launched 09:48:51.709313 run scp-cfg-to-remote(pid=2162): Terminated: ok {rc=0} 09:48:52.008114 run scp-db-to-remote(pid=2164): Launched 09:48:53.193272 run scp-db-to-remote(pid=2164): Terminated: ok {rc=0} 09:48:53.331590 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:48:53.654360 run patchelf(pid=2166): Launched 09:48:54.838194 run patchelf(pid=2166): Terminated: ok {rc=0} 09:48:54.976060 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:48:55.298643 run setcap-netadm(pid=2167): Launched 09:48:56.483456 run setcap-netadm(pid=2167): Terminated: ok {rc=0} 09:48:56.821661 run srsepc(pid=2168): Launched 09:48:56.941170 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:48:58.105656 run rm-remote-dir(pid=2169): Launched 09:48:58.289843 run srsepc(pid=2168): ERR: Terminated: ERROR {rc=127} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2168)] 09:48:58.432503 run srsepc(pid=2168): stdout: | (launched: 2022-12-13_09:48:56.763470) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:48:58.575235 run srsepc(pid=2168): stderr: | (launched: 2022-12-13_09:48:56.811289) | Connection to 10.42.42.116 closed. 09:48:58.717989 run srsepc(pid=2168): stdout: | (launched: 2022-12-13_09:48:56.763470) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:48:58.854242 run srsepc(pid=2168): stderr: | (launched: 2022-12-13_09:48:56.811289) | Connection to 10.42.42.116 closed. 09:48:59.015807 run rm-remote-dir(pid=2169): Terminating (SIGINT) 09:48:59.203199 run rm-remote-dir(pid=2169): Terminated: ok {rc=0} 09:48:59.338347 tst ping.py:16: ERR: Error: srsepc(pid=2168): Process ended prematurely: srsepc(pid=2168) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2168)] [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 09:48:59.349115 tst ping.py:16: Test FAILED (18.3 sec) 09:48:59.429670 run scp-back-log(pid=2170): Launched 09:49:00.509319 run scp-back-log(pid=2170): ERR: Terminated: ERROR {rc=1} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2170)] 09:49:00.573820 run scp-back-log(pid=2170): stdout: | (launched: 2022-12-13_09:48:59.398594) 09:49:00.638970 run scp-back-log(pid=2170): stderr: | (launched: 2022-12-13_09:48:59.419161) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:49:00.712022 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2170): launch_sync(): local process exited with status 1 [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2170)]') ---------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 09:49:00.759552 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:49:00.776860 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:49:00.800894 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:49:00.854285 tst rrc_idle_mo_ping.py: using MSISDN 8103 09:49:00.983165 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8103', subscriber_id=0} 09:49:01.099096 run srsepc_10.42.42.118: Starting srsepc 09:49:01.775071 run rm-remote-dir(pid=2172): Launched 09:49:03.070339 run rm-remote-dir(pid=2172): Terminated: ok {rc=0} 09:49:03.400590 run mk-remote-dir(pid=2173): Launched 09:49:04.580719 run mk-remote-dir(pid=2173): Terminated: ok {rc=0} 09:49:04.880685 run scp-inst-to-remote(pid=2174): Launched 09:49:07.067618 run scp-inst-to-remote(pid=2174): Terminated: ok {rc=0} 09:49:07.418814 run rm-remote-dir(pid=2176): Launched 09:49:08.606030 run rm-remote-dir(pid=2176): Terminated: ok {rc=0} 09:49:08.958139 run mk-remote-dir(pid=2177): Launched 09:49:10.140916 run mk-remote-dir(pid=2177): Terminated: ok {rc=0} 09:49:10.423093 run scp-cfg-to-remote(pid=2178): Launched 09:49:11.600158 run scp-cfg-to-remote(pid=2178): Terminated: ok {rc=0} 09:49:11.879642 run scp-db-to-remote(pid=2180): Launched 09:49:13.100497 run scp-db-to-remote(pid=2180): Terminated: ok {rc=0} 09:49:13.239008 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:49:13.563104 run patchelf(pid=2182): Launched 09:49:14.747876 run patchelf(pid=2182): Terminated: ok {rc=0} 09:49:14.886206 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:49:15.210692 run setcap-netadm(pid=2183): Launched 09:49:16.411369 run setcap-netadm(pid=2183): Terminated: ok {rc=0} 09:49:16.773313 run srsepc(pid=2184): Launched 09:49:16.944176 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:49:18.107307 run rm-remote-dir(pid=2185): Launched 09:49:18.283147 run srsepc(pid=2184): ERR: Terminated: ERROR {rc=127} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2184)] 09:49:18.416918 run srsepc(pid=2184): stdout: | (launched: 2022-12-13_09:49:16.709078) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:49:18.551237 run srsepc(pid=2184): stderr: | (launched: 2022-12-13_09:49:16.755389) | Connection to 10.42.42.116 closed. 09:49:18.684807 run srsepc(pid=2184): stdout: | (launched: 2022-12-13_09:49:16.709078) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:49:18.812047 run srsepc(pid=2184): stderr: | (launched: 2022-12-13_09:49:16.755389) | Connection to 10.42.42.116 closed. 09:49:18.963081 run rm-remote-dir(pid=2185): Terminating (SIGINT) 09:49:19.138814 run rm-remote-dir(pid=2185): Terminated: ok {rc=0} 09:49:19.265881 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=2184): Process ended prematurely: srsepc(pid=2184) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2184)] [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 09:49:19.275516 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 09:49:19.350610 run scp-back-log(pid=2186): Launched 09:49:20.426984 run scp-back-log(pid=2186): ERR: Terminated: ERROR {rc=1} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2186)] 09:49:20.487127 run scp-back-log(pid=2186): stdout: | (launched: 2022-12-13_09:49:19.321287) 09:49:20.548512 run scp-back-log(pid=2186): stderr: | (launched: 2022-12-13_09:49:19.340772) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:49:20.618365 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2186): launch_sync(): local process exited with status 1 [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2186)]') ---------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 09:49:20.662864 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:49:20.679068 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:49:20.701513 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:49:20.749670 tst rrc_idle_mt_ping.py: using MSISDN 8104 09:49:20.869973 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8104', subscriber_id=0} 09:49:20.983685 run srsepc_10.42.42.118: Starting srsepc 09:49:21.646794 run rm-remote-dir(pid=2189): Launched 09:49:22.834052 run rm-remote-dir(pid=2189): Terminated: ok {rc=0} 09:49:23.187981 run mk-remote-dir(pid=2190): Launched 09:49:24.374793 run mk-remote-dir(pid=2190): Terminated: ok {rc=0} 09:49:24.677233 run scp-inst-to-remote(pid=2191): Launched 09:49:26.864621 run scp-inst-to-remote(pid=2191): Terminated: ok {rc=0} 09:49:27.216167 run rm-remote-dir(pid=2193): Launched 09:49:28.402692 run rm-remote-dir(pid=2193): Terminated: ok {rc=0} 09:49:28.757065 run mk-remote-dir(pid=2194): Launched 09:49:29.944480 run mk-remote-dir(pid=2194): Terminated: ok {rc=0} 09:49:30.245361 run scp-cfg-to-remote(pid=2195): Launched 09:49:31.438792 run scp-cfg-to-remote(pid=2195): Terminated: ok {rc=0} 09:49:31.837025 run scp-db-to-remote(pid=2197): Launched 09:49:33.156821 run scp-db-to-remote(pid=2197): Terminated: ok {rc=0} 09:49:33.295587 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:49:33.620563 run patchelf(pid=2199): Launched 09:49:34.806084 run patchelf(pid=2199): Terminated: ok {rc=0} 09:49:34.944859 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:49:35.270123 run setcap-netadm(pid=2200): Launched 09:49:36.454887 run setcap-netadm(pid=2200): Terminated: ok {rc=0} 09:49:36.796489 run srsepc(pid=2201): Launched 09:49:36.916603 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:49:38.084117 run rm-remote-dir(pid=2202): Launched 09:49:38.268234 run srsepc(pid=2201): ERR: Terminated: ERROR {rc=127} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2201)] 09:49:38.409348 run srsepc(pid=2201): stdout: | (launched: 2022-12-13_09:49:36.737625) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:49:38.551582 run srsepc(pid=2201): stderr: | (launched: 2022-12-13_09:49:36.785896) | Connection to 10.42.42.116 closed. 09:49:38.693051 run srsepc(pid=2201): stdout: | (launched: 2022-12-13_09:49:36.737625) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:49:38.829694 run srsepc(pid=2201): stderr: | (launched: 2022-12-13_09:49:36.785896) | Connection to 10.42.42.116 closed. 09:49:38.990744 run rm-remote-dir(pid=2202): Terminating (SIGINT) 09:49:39.177672 run rm-remote-dir(pid=2202): Terminated: ok {rc=0} 09:49:39.313316 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=2201): Process ended prematurely: srsepc(pid=2201) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2201)] [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 09:49:39.323773 tst rrc_idle_mt_ping.py:16: Test FAILED (18.7 sec) 09:49:39.403445 run scp-back-log(pid=2203): Launched 09:49:40.482550 run scp-back-log(pid=2203): ERR: Terminated: ERROR {rc=1} [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2203)] 09:49:40.546194 run scp-back-log(pid=2203): stdout: | (launched: 2022-12-13_09:49:39.372561) 09:49:40.611040 run scp-back-log(pid=2203): stderr: | (launched: 2022-12-13_09:49:39.393166) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:49:40.684245 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2203): launch_sync(): local process exited with status 1 [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2203)]') --------------------------------------------------------------------- trial-2387 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 09:49:40.819750 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:49:40.826731 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 09:49:40.869985 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 09:49:40.897131 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 09:49:40.948113 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 09:49:40.992427 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 09:49:41.019523 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 09:49:41.565693 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 09:49:41.571684 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:49:41.582889 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:49:41.620491 tst handover.py: using LAC 33131 09:49:41.743401 tst handover.py: using RAC 236 09:49:41.858144 tst handover.py: using CellId 33131 09:49:41.973622 tst handover.py: using BVCI 33132 09:49:42.083370 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:49:42.116383 tst handover.py: using LAC 33132 09:49:42.231741 tst handover.py: using RAC 237 09:49:42.346939 tst handover.py: using CellId 33132 09:49:42.462304 tst handover.py: using BVCI 33133 09:49:42.571551 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:49:42.582423 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:49:42.592800 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:49:42.603296 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:49:42.613830 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:49:42.624239 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:49:42.742513 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:49:42.856183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:49:43.317423 run create_hlr_db(pid=2210): Launched 09:49:44.484181 run create_hlr_db(pid=2210): Terminated: ok {rc=0} 09:49:44.797403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2212): Launched 09:49:45.093701 run osmo-hlr_10.42.42.2(pid=2213): Launched 09:49:45.206626 run osmo-stp_10.42.42.5: Starting osmo-stp 09:49:45.716621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2215): Launched 09:49:46.043325 run osmo-stp_10.42.42.5(pid=2216): Launched 09:49:46.224577 run osmo-msc_10.42.42.6: Starting osmo-msc 09:49:46.843353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2218): Launched 09:49:47.155579 run osmo-msc_10.42.42.6(pid=2219): Launched 09:49:47.334985 run osmo-stp_10.42.42.5(pid=2216): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2216)] 09:49:47.512844 run osmo-stp_10.42.42.5(pid=2216): stdout: | (launched: 2022-12-13_09:49:45.979086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:47.702955 run osmo-stp_10.42.42.5(pid=2216): stderr: | 20221213094946363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094946363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094946363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094946363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094946364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094946364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094946364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:47.829492 run osmo-stp_10.42.42.5(pid=2216): stdout: | (launched: 2022-12-13_09:49:45.979086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:47.948354 run osmo-stp_10.42.42.5(pid=2216): stderr: | 20221213094946363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094946363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094946363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094946363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094946364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094946364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094946364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:48.090522 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2216): Process ended prematurely: osmo-stp_10.42.42.5(pid=2216) [trial-2387↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2216)] [trial-2387↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 09:49:48.098643 tst handover.py:18: Test FAILED (6.5 sec) 09:49:48.124351 run osmo-hlr_10.42.42.2(pid=2213): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2213)] 09:49:48.171658 run osmo-hlr_10.42.42.2(pid=2213): stdout: | (launched: 2022-12-13_09:49:45.039699) 09:49:48.220813 run osmo-hlr_10.42.42.2(pid=2213): stderr: | 20221213094945215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094945215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094945215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094945215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094945215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094945215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094945227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094945238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094945238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094945238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:49:48.289211 run osmo-msc_10.42.42.6(pid=2219): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2219)] 09:49:48.336493 run osmo-msc_10.42.42.6(pid=2219): stdout: | (launched: 2022-12-13_09:49:47.093648) 09:49:48.385236 run osmo-msc_10.42.42.6(pid=2219): stderr: | 20221213094947619 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094947620 DLGLOBAL DEBUG validating counter group 0x7fa69ca68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094947620 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094947620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094947620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094947620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094947624 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094947624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094947624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094947624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:49:48.434664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2212): Terminating (SIGTERM) 09:49:48.473980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2215): Terminating (SIGTERM) 09:49:48.513283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2218): Terminating (SIGTERM) 09:49:48.553420 --- ParallelTerminationStrategy: PID 2212 died... 09:49:48.572343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2212): Terminated: ok {rc=0} 09:49:48.616198 --- ParallelTerminationStrategy: PID 2215 died... 09:49:48.634819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2215): Terminated: ok {rc=0} 09:49:48.678345 --- ParallelTerminationStrategy: PID 2218 died... 09:49:48.696761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2218): Terminated: ok {rc=0} 09:49:48.782536 bus /sierra_3: Setting Powered False 09:49:49.881051 bus /sierra_3: Setting Powered False 09:49:50.992417 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 09:49:52.238078 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:49:52.243521 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:49:52.284395 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:49:52.312503 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:49:52.364552 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:49:52.404655 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:49:52.432360 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:49:52.987421 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 09:49:52.992746 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:49:53.003989 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:49:53.042313 tst handover.py: using LAC 33133 09:49:53.168453 tst handover.py: using RAC 238 09:49:53.293326 tst handover.py: using CellId 33133 09:49:53.419862 tst handover.py: using BVCI 33134 09:49:53.537786 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:49:53.572921 tst handover.py: using LAC 33134 09:49:53.699300 tst handover.py: using RAC 239 09:49:53.825668 tst handover.py: using CellId 33134 09:49:53.953068 tst handover.py: using BVCI 33135 09:49:54.069542 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:49:54.080738 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:49:54.091980 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:49:54.103026 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:49:54.114528 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:49:54.126010 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:49:54.244250 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:49:54.363210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:49:54.829067 run create_hlr_db(pid=2225): Launched 09:49:54.958761 bus /sierra_2: Setting Powered False 09:49:56.021895 run create_hlr_db(pid=2225): Terminated: ok {rc=0} 09:49:56.422981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2227): Launched 09:49:56.721497 run osmo-hlr_10.42.42.2(pid=2228): Launched 09:49:56.836661 run osmo-stp_10.42.42.5: Starting osmo-stp 09:49:57.340598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2230): Launched 09:49:57.639558 run osmo-stp_10.42.42.5(pid=2231): Launched 09:49:57.754929 run osmo-msc_10.42.42.6: Starting osmo-msc 09:49:58.271110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2233): Launched 09:49:58.571819 run osmo-msc_10.42.42.6(pid=2234): Launched 09:49:58.739631 run osmo-stp_10.42.42.5(pid=2231): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2231)] 09:49:58.868912 run osmo-stp_10.42.42.5(pid=2231): stdout: | (launched: 2022-12-13_09:49:57.585169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:58.996260 run osmo-stp_10.42.42.5(pid=2231): stderr: | 20221213094957752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094957752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094957753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094957753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094957754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094957754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094957754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:59.121972 run osmo-stp_10.42.42.5(pid=2231): stdout: | (launched: 2022-12-13_09:49:57.585169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:59.241559 run osmo-stp_10.42.42.5(pid=2231): stderr: | 20221213094957752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213094957752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213094957753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213094957753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213094957754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213094957754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213094957754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:59.384675 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2231): Process ended prematurely: osmo-stp_10.42.42.5(pid=2231) [trial-2387↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2231)] [trial-2387↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 09:49:59.393231 tst handover.py:18: Test FAILED (6.4 sec) 09:49:59.419111 run osmo-hlr_10.42.42.2(pid=2228): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2228)] 09:49:59.467032 run osmo-hlr_10.42.42.2(pid=2228): stdout: | (launched: 2022-12-13_09:49:56.667064) 09:49:59.516785 run osmo-hlr_10.42.42.2(pid=2228): stderr: | 20221213094956844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213094956844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213094956844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213094956844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213094956844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213094956844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213094956856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213094956865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213094956865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213094956865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:49:59.586066 run osmo-msc_10.42.42.6(pid=2234): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2234)] 09:49:59.633529 run osmo-msc_10.42.42.6(pid=2234): stdout: | (launched: 2022-12-13_09:49:58.517270) 09:49:59.682980 run osmo-msc_10.42.42.6(pid=2234): stderr: | 20221213094958789 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213094958789 DLGLOBAL DEBUG validating counter group 0x7f8b636bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213094958790 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213094958790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213094958790 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213094958790 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213094958792 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213094958792 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213094958792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213094958792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:49:59.732876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2227): Terminating (SIGTERM) 09:49:59.772739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2230): Terminating (SIGTERM) 09:49:59.812405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2233): Terminating (SIGTERM) 09:49:59.852423 --- ParallelTerminationStrategy: PID 2227 died... 09:49:59.871725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2227): Terminated: ok {rc=0} 09:49:59.915729 --- ParallelTerminationStrategy: PID 2230 died... 09:49:59.934363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2230): Terminated: ok {rc=0} 09:49:59.978733 --- ParallelTerminationStrategy: PID 2233 died... 09:49:59.997683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2233): Terminated: ok {rc=0} 09:50:00.083051 bus /sierra_3: Setting Powered False 09:50:01.187095 bus /sierra_3: Setting Powered False 09:50:02.325094 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 09:50:03.561808 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:03.568362 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:50:03.623002 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:50:03.650079 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:50:03.703360 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:50:03.758118 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:50:03.785114 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:50:04.335710 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 09:50:04.340926 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:50:04.352163 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:50:04.389609 tst handover.py: using LAC 33135 09:50:04.514705 tst handover.py: using RAC 240 09:50:04.641451 tst handover.py: using CellId 33135 09:50:04.765686 tst handover.py: using BVCI 33136 09:50:04.880911 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:50:04.929073 tst handover.py: using LAC 33136 09:50:05.053717 tst handover.py: using RAC 241 09:50:05.176037 tst handover.py: using CellId 33136 09:50:05.292267 tst handover.py: using BVCI 33137 09:50:05.400867 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:50:05.411752 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:50:05.422427 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:50:05.432905 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:50:05.444021 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:50:05.454947 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:50:05.570425 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:50:05.688858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:50:06.154605 run create_hlr_db(pid=2249): Launched 09:50:06.284339 bus /sierra_2: Setting Powered False 09:50:07.348094 run create_hlr_db(pid=2249): Terminated: ok {rc=0} 09:50:07.749443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Launched 09:50:08.048370 run osmo-hlr_10.42.42.2(pid=2252): Launched 09:50:08.163384 run osmo-stp_10.42.42.5: Starting osmo-stp 09:50:08.661721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Launched 09:50:08.960382 run osmo-stp_10.42.42.5(pid=2255): Launched 09:50:09.074982 run osmo-msc_10.42.42.6: Starting osmo-msc 09:50:09.589184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2257): Launched 09:50:09.887997 run osmo-msc_10.42.42.6(pid=2258): Launched 09:50:10.055830 run osmo-stp_10.42.42.5(pid=2255): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] 09:50:10.184802 run osmo-stp_10.42.42.5(pid=2255): stdout: | (launched: 2022-12-13_09:50:08.905824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:10.312045 run osmo-stp_10.42.42.5(pid=2255): stderr: | 20221213095009075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095009075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095009076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095009076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095009077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095009077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095009077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:10.436838 run osmo-stp_10.42.42.5(pid=2255): stdout: | (launched: 2022-12-13_09:50:08.905824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:10.555780 run osmo-stp_10.42.42.5(pid=2255): stderr: | 20221213095009075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095009075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095009076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095009076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095009077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095009077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095009077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:10.698508 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2255): Process ended prematurely: osmo-stp_10.42.42.5(pid=2255) [trial-2387↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] [trial-2387↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 09:50:10.706678 tst handover.py:18: Test FAILED (6.4 sec) 09:50:10.732237 run osmo-hlr_10.42.42.2(pid=2252): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2252)] 09:50:10.780321 run osmo-hlr_10.42.42.2(pid=2252): stdout: | (launched: 2022-12-13_09:50:07.994242) 09:50:10.829322 run osmo-hlr_10.42.42.2(pid=2252): stderr: | 20221213095008167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095008167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095008167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095008167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095008167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095008167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095008179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095008189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095008189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095008189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:50:10.897746 run osmo-msc_10.42.42.6(pid=2258): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2258)] 09:50:10.944683 run osmo-msc_10.42.42.6(pid=2258): stdout: | (launched: 2022-12-13_09:50:09.833277) 09:50:10.993589 run osmo-msc_10.42.42.6(pid=2258): stderr: | 20221213095010104 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095010104 DLGLOBAL DEBUG validating counter group 0x7efe6109bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095010105 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095010105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095010105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095010105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095010107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095010107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095010107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095010107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:50:11.042713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Terminating (SIGTERM) 09:50:11.082189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Terminating (SIGTERM) 09:50:11.121798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2257): Terminating (SIGTERM) 09:50:11.161412 --- ParallelTerminationStrategy: PID 2251 died... 09:50:11.180380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Terminated: ok {rc=0} 09:50:11.224340 --- ParallelTerminationStrategy: PID 2254 died... 09:50:11.243091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Terminated: ok {rc=0} 09:50:11.286423 --- ParallelTerminationStrategy: PID 2257 died... 09:50:11.305047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2257): Terminated: ok {rc=0} 09:50:11.388067 bus /sierra_3: Setting Powered False 09:50:12.486968 bus /sierra_3: Setting Powered False 09:50:13.613076 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:50:14.879515 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:14.885871 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:50:14.936259 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:50:14.962205 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:50:15.012456 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:50:15.061363 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:50:15.087218 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:50:15.639739 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:50:15.646400 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:50:15.658580 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:50:15.696176 tst handover.py: using LAC 33137 09:50:15.813844 tst handover.py: using RAC 242 09:50:15.940245 tst handover.py: using CellId 33137 09:50:16.067871 tst handover.py: using BVCI 33138 09:50:16.182384 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:50:16.227030 tst handover.py: using LAC 33138 09:50:16.355223 tst handover.py: using RAC 243 09:50:16.484058 tst handover.py: using CellId 33138 09:50:16.602575 tst handover.py: using BVCI 33139 09:50:16.747845 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:50:16.762739 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:50:16.776853 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:50:16.792548 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:50:16.808471 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:50:16.823520 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:50:16.967623 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:50:17.109734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:50:17.585315 run create_hlr_db(pid=2614): Launched 09:50:17.715944 bus /sierra_2: Setting Powered False 09:50:18.774969 run create_hlr_db(pid=2614): Terminated: ok {rc=0} 09:50:19.183200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2616): Launched 09:50:19.502967 run osmo-hlr_10.42.42.2(pid=2617): Launched 09:50:19.624862 run osmo-stp_10.42.42.5: Starting osmo-stp 09:50:20.148620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2620): Launched 09:50:20.466944 run osmo-stp_10.42.42.5(pid=2622): Launched 09:50:20.588815 run osmo-msc_10.42.42.6: Starting osmo-msc 09:50:21.142933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2625): Launched 09:50:21.463016 run osmo-msc_10.42.42.6(pid=2626): Launched 09:50:21.640831 run osmo-stp_10.42.42.5(pid=2622): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2622)] 09:50:21.775325 run osmo-stp_10.42.42.5(pid=2622): stdout: | (launched: 2022-12-13_09:50:20.408518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:21.910720 run osmo-stp_10.42.42.5(pid=2622): stderr: | 20221213095020598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095020598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095020598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095020599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095020601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095020601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095020601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:22.045050 run osmo-stp_10.42.42.5(pid=2622): stdout: | (launched: 2022-12-13_09:50:20.408518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:22.173484 run osmo-stp_10.42.42.5(pid=2622): stderr: | 20221213095020598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095020598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095020598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095020599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095020601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095020601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095020601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:22.327089 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2622): Process ended prematurely: osmo-stp_10.42.42.5(pid=2622) [trial-2387↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2622)] [trial-2387↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 09:50:22.336579 tst handover.py:18: Test FAILED (6.7 sec) 09:50:22.364909 run osmo-hlr_10.42.42.2(pid=2617): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2617)] 09:50:22.415789 run osmo-hlr_10.42.42.2(pid=2617): stdout: | (launched: 2022-12-13_09:50:19.445123) 09:50:22.469044 run osmo-hlr_10.42.42.2(pid=2617): stderr: | 20221213095019643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095019643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095019643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095019643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095019643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095019643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095019655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095019664 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095019664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095019664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:50:22.541462 run osmo-msc_10.42.42.6(pid=2626): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2626)] 09:50:22.592253 run osmo-msc_10.42.42.6(pid=2626): stdout: | (launched: 2022-12-13_09:50:21.404534) 09:50:22.645146 run osmo-msc_10.42.42.6(pid=2626): stderr: | 20221213095021728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095021728 DLGLOBAL DEBUG validating counter group 0x7fe0c8377c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095021728 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095021728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095021728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095021728 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095021730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095021731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095021731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095021731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:50:22.699563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2616): Terminating (SIGTERM) 09:50:22.742178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2620): Terminating (SIGTERM) 09:50:22.784681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2625): Terminating (SIGTERM) 09:50:22.827577 --- ParallelTerminationStrategy: PID 2616 died... 09:50:22.847676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2616): Terminated: ok {rc=0} 09:50:22.894368 --- ParallelTerminationStrategy: PID 2620 died... 09:50:22.914688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2620): Terminated: ok {rc=0} 09:50:22.961376 --- ParallelTerminationStrategy: PID 2625 died... 09:50:22.981435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2625): Terminated: ok {rc=0} 09:50:23.070934 bus /sierra_3: Setting Powered False 09:50:24.171679 bus /sierra_3: Setting Powered False 09:50:25.291956 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:50:26.556302 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:26.562937 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:50:26.623214 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:50:26.651422 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:50:26.705807 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:50:26.762494 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:50:26.790442 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:50:27.344759 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:50:27.352426 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:50:27.365339 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:50:27.407754 tst handover.py: using LAC 33139 09:50:27.541482 tst handover.py: using RAC 244 09:50:27.676099 tst handover.py: using CellId 33139 09:50:27.807200 tst handover.py: using BVCI 33140 09:50:27.928094 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:50:27.984886 tst handover.py: using LAC 33140 09:50:28.119055 tst handover.py: using RAC 245 09:50:28.255317 tst handover.py: using CellId 33140 09:50:28.375313 tst handover.py: using BVCI 33141 09:50:28.485044 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:50:28.496104 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:50:28.507006 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:50:28.517955 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:50:28.529217 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:50:28.540126 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:50:28.659852 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:50:28.778556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:50:29.244892 run create_hlr_db(pid=2807): Launched 09:50:29.374482 bus /sierra_2: Setting Powered False 09:50:30.437908 run create_hlr_db(pid=2807): Terminated: ok {rc=0} 09:50:30.838359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2809): Launched 09:50:31.211718 run osmo-hlr_10.42.42.2(pid=2810): Launched 09:50:31.378533 run osmo-stp_10.42.42.5: Starting osmo-stp 09:50:32.034428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2812): Launched 09:50:32.402766 run osmo-stp_10.42.42.5(pid=2813): Launched 09:50:32.518272 run osmo-msc_10.42.42.6: Starting osmo-msc 09:50:33.047770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2815): Launched 09:50:33.347181 run osmo-msc_10.42.42.6(pid=2816): Launched 09:50:33.515019 run osmo-stp_10.42.42.5(pid=2813): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2813)] 09:50:33.643951 run osmo-stp_10.42.42.5(pid=2813): stdout: | (launched: 2022-12-13_09:50:32.347403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:33.771271 run osmo-stp_10.42.42.5(pid=2813): stderr: | 20221213095032519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095032519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095032519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095032520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095032520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095032520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095032520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:33.895706 run osmo-stp_10.42.42.5(pid=2813): stdout: | (launched: 2022-12-13_09:50:32.347403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:34.015191 run osmo-stp_10.42.42.5(pid=2813): stderr: | 20221213095032519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095032519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095032519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095032520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095032520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095032520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095032520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:34.158183 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2813): Process ended prematurely: osmo-stp_10.42.42.5(pid=2813) [trial-2387↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2813)] [trial-2387↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 09:50:34.166552 tst handover.py:18: Test FAILED (6.8 sec) 09:50:34.192515 run osmo-hlr_10.42.42.2(pid=2810): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2810)] 09:50:34.240816 run osmo-hlr_10.42.42.2(pid=2810): stdout: | (launched: 2022-12-13_09:50:31.150697) 09:50:34.290288 run osmo-hlr_10.42.42.2(pid=2810): stderr: | 20221213095031532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095031532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095031535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095031535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095031535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095031535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095031556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095031570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095031571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095031571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:50:34.359985 run osmo-msc_10.42.42.6(pid=2816): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2816)] 09:50:34.407505 run osmo-msc_10.42.42.6(pid=2816): stdout: | (launched: 2022-12-13_09:50:33.292753) 09:50:34.457114 run osmo-msc_10.42.42.6(pid=2816): stderr: | 20221213095033564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095033564 DLGLOBAL DEBUG validating counter group 0x7f402c8acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095033564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095033564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095033564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095033564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095033568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095033568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095033568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095033568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:50:34.506930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2809): Terminating (SIGTERM) 09:50:34.546704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2812): Terminating (SIGTERM) 09:50:34.586638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2815): Terminating (SIGTERM) 09:50:34.626723 --- ParallelTerminationStrategy: PID 2809 died... 09:50:34.646126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2809): Terminated: ok {rc=0} 09:50:34.690829 --- ParallelTerminationStrategy: PID 2812 died... 09:50:34.709806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2812): Terminated: ok {rc=0} 09:50:34.754189 --- ParallelTerminationStrategy: PID 2815 died... 09:50:34.773402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2815): Terminated: ok {rc=0} 09:50:34.859964 bus /sierra_3: Setting Powered False 09:50:35.958689 bus /sierra_3: Setting Powered False 09:50:37.072791 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 09:50:38.333462 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:38.340218 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:50:38.383468 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:50:38.410873 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:50:38.463682 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:50:38.505934 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:50:38.533092 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:50:39.081329 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 09:50:39.086760 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:50:39.097754 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:50:39.134895 tst handover.py: using LAC 33141 09:50:39.253082 tst handover.py: using RAC 246 09:50:39.372057 tst handover.py: using CellId 33141 09:50:39.492458 tst handover.py: using BVCI 33142 09:50:39.601498 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:50:39.637390 tst handover.py: using LAC 33142 09:50:39.752761 tst handover.py: using RAC 247 09:50:39.867836 tst handover.py: using CellId 33142 09:50:39.983297 tst handover.py: using BVCI 33143 09:50:40.091267 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:50:40.102220 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:50:40.112907 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:50:40.123879 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:50:40.134969 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:50:40.145892 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:50:40.260883 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:50:40.375898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:50:40.814345 run create_hlr_db(pid=2821): Launched 09:50:40.928164 bus /sierra_2: Setting Powered False 09:50:41.990721 run create_hlr_db(pid=2821): Terminated: ok {rc=0} 09:50:42.391348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2823): Launched 09:50:42.709125 run osmo-hlr_10.42.42.2(pid=2824): Launched 09:50:42.830749 run osmo-stp_10.42.42.5: Starting osmo-stp 09:50:43.351740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2826): Launched 09:50:43.670869 run osmo-stp_10.42.42.5(pid=2827): Launched 09:50:43.792807 run osmo-msc_10.42.42.6: Starting osmo-msc 09:50:44.340038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2829): Launched 09:50:44.658814 run osmo-msc_10.42.42.6(pid=2830): Launched 09:50:44.836920 run osmo-stp_10.42.42.5(pid=2827): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2827)] 09:50:44.971416 run osmo-stp_10.42.42.5(pid=2827): stdout: | (launched: 2022-12-13_09:50:43.613213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:45.106689 run osmo-stp_10.42.42.5(pid=2827): stderr: | 20221213095043805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095043805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095043805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095043806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095043806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095043806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095043806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:45.241268 run osmo-stp_10.42.42.5(pid=2827): stdout: | (launched: 2022-12-13_09:50:43.613213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:45.368688 run osmo-stp_10.42.42.5(pid=2827): stderr: | 20221213095043805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095043805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095043805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095043806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095043806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095043806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095043806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:45.521620 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2827): Process ended prematurely: osmo-stp_10.42.42.5(pid=2827) [trial-2387↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2827)] [trial-2387↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 09:50:45.530476 tst handover.py:18: Test FAILED (6.4 sec) 09:50:45.557451 run osmo-hlr_10.42.42.2(pid=2824): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2824)] 09:50:45.607152 run osmo-hlr_10.42.42.2(pid=2824): stdout: | (launched: 2022-12-13_09:50:42.651468) 09:50:45.658595 run osmo-hlr_10.42.42.2(pid=2824): stderr: | 20221213095042851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095042851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095042851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095042852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095042852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095042852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095042865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095042875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095042875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095042875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:50:45.730207 run osmo-msc_10.42.42.6(pid=2830): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2830)] 09:50:45.779920 run osmo-msc_10.42.42.6(pid=2830): stdout: | (launched: 2022-12-13_09:50:44.600868) 09:50:45.831221 run osmo-msc_10.42.42.6(pid=2830): stderr: | 20221213095044922 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095044922 DLGLOBAL DEBUG validating counter group 0x7f060b140c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095044922 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095044922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095044922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095044922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095044924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095044924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095044925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095044925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:50:45.886619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2823): Terminating (SIGTERM) 09:50:45.932760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2826): Terminating (SIGTERM) 09:50:45.977241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2829): Terminating (SIGTERM) 09:50:46.022989 --- ParallelTerminationStrategy: PID 2823 died... 09:50:46.044047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2823): Terminated: ok {rc=0} 09:50:46.091843 --- ParallelTerminationStrategy: PID 2826 died... 09:50:46.112385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2826): Terminated: ok {rc=0} 09:50:46.160096 --- ParallelTerminationStrategy: PID 2829 died... 09:50:46.180873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2829): Terminated: ok {rc=0} 09:50:46.269887 bus /sierra_3: Setting Powered False 09:50:47.364724 bus /sierra_3: Setting Powered False 09:50:48.478260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 09:50:49.724368 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:49.729412 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:50:49.782214 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:50:49.808294 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:50:49.858929 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:50:49.911836 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:50:49.937936 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:50:50.494540 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 09:50:50.500202 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:50:50.511649 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:50:50.549976 tst handover.py: using LAC 33143 09:50:50.676174 tst handover.py: using RAC 248 09:50:50.802613 tst handover.py: using CellId 33143 09:50:50.929662 tst handover.py: using BVCI 33144 09:50:51.046719 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:50:51.096707 tst handover.py: using LAC 33144 09:50:51.215662 tst handover.py: using RAC 249 09:50:51.342737 tst handover.py: using CellId 33144 09:50:51.468170 tst handover.py: using BVCI 33145 09:50:51.583829 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:50:51.595203 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:50:51.606480 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:50:51.617733 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:50:51.628909 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:50:51.640211 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:50:51.756267 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:50:51.878053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:50:52.344508 run create_hlr_db(pid=2837): Launched 09:50:52.472933 bus /sierra_2: Setting Powered False 09:50:53.535643 run create_hlr_db(pid=2837): Terminated: ok {rc=0} 09:50:53.935355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2839): Launched 09:50:54.234173 run osmo-hlr_10.42.42.2(pid=2840): Launched 09:50:54.348752 run osmo-stp_10.42.42.5: Starting osmo-stp 09:50:54.852710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2842): Launched 09:50:55.151202 run osmo-stp_10.42.42.5(pid=2843): Launched 09:50:55.265531 run osmo-msc_10.42.42.6: Starting osmo-msc 09:50:55.782202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2845): Launched 09:50:56.081104 run osmo-msc_10.42.42.6(pid=2846): Launched 09:50:56.249256 run osmo-stp_10.42.42.5(pid=2843): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2843)] 09:50:56.376631 run osmo-stp_10.42.42.5(pid=2843): stdout: | (launched: 2022-12-13_09:50:55.097067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:56.503844 run osmo-stp_10.42.42.5(pid=2843): stderr: | 20221213095055267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095055267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095055267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095055268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095055268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095055268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095055268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:56.628549 run osmo-stp_10.42.42.5(pid=2843): stdout: | (launched: 2022-12-13_09:50:55.097067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:56.747660 run osmo-stp_10.42.42.5(pid=2843): stderr: | 20221213095055267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095055267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095055267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095055268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095055268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095055268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095055268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:56.890637 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2843): Process ended prematurely: osmo-stp_10.42.42.5(pid=2843) [trial-2387↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2843)] [trial-2387↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 09:50:56.899042 tst handover.py:18: Test FAILED (6.4 sec) 09:50:56.924795 run osmo-hlr_10.42.42.2(pid=2840): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2840)] 09:50:56.972924 run osmo-hlr_10.42.42.2(pid=2840): stdout: | (launched: 2022-12-13_09:50:54.179758) 09:50:57.022085 run osmo-hlr_10.42.42.2(pid=2840): stderr: | 20221213095054355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095054355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095054355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095054355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095054355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095054355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095054368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095054378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095054378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095054378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:50:57.091142 run osmo-msc_10.42.42.6(pid=2846): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2846)] 09:50:57.138384 run osmo-msc_10.42.42.6(pid=2846): stdout: | (launched: 2022-12-13_09:50:56.026191) 09:50:57.187545 run osmo-msc_10.42.42.6(pid=2846): stderr: | 20221213095056296 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095056296 DLGLOBAL DEBUG validating counter group 0x7f350b79ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095056296 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095056296 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095056296 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095056296 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095056298 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095056299 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095056299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095056299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:50:57.237028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2839): Terminating (SIGTERM) 09:50:57.276747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2842): Terminating (SIGTERM) 09:50:57.316319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2845): Terminating (SIGTERM) 09:50:57.356529 --- ParallelTerminationStrategy: PID 2839 died... 09:50:57.375983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2839): Terminated: ok {rc=0} 09:50:57.419732 --- ParallelTerminationStrategy: PID 2842 died... 09:50:57.438569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2842): Terminated: ok {rc=0} 09:50:57.482414 --- ParallelTerminationStrategy: PID 2845 died... 09:50:57.501248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2845): Terminated: ok {rc=0} 09:50:57.585895 bus /sierra_3: Setting Powered False 09:50:58.683194 bus /sierra_3: Setting Powered False 09:50:59.797723 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 09:51:01.079282 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:01.087816 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:51:01.158923 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:51:01.195550 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:51:01.264606 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:51:01.350060 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:51:01.386562 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:51:01.974096 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 09:51:01.980470 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:51:01.992603 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:51:02.081521 tst handover.py: using LAC 33145 09:51:02.201857 tst handover.py: using RAC 250 09:51:02.358231 tst handover.py: using CellId 33145 09:51:02.477915 tst handover.py: using BVCI 33146 09:51:02.595586 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:51:02.643283 tst handover.py: using LAC 33146 09:51:02.767617 tst handover.py: using RAC 251 09:51:02.890716 tst handover.py: using CellId 33146 09:51:03.013911 tst handover.py: using BVCI 33147 09:51:03.129658 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:51:03.141098 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:51:03.152303 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:51:03.163684 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:51:03.175317 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:51:03.186631 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:51:03.302220 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:51:03.415984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:03.854297 run create_hlr_db(pid=2851): Launched 09:51:03.968088 bus /sierra_2: Setting Powered False 09:51:05.028321 run create_hlr_db(pid=2851): Terminated: ok {rc=0} 09:51:05.435770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2853): Launched 09:51:05.754533 run osmo-hlr_10.42.42.2(pid=2854): Launched 09:51:05.876346 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:06.395337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2856): Launched 09:51:06.714468 run osmo-stp_10.42.42.5(pid=2857): Launched 09:51:06.835549 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:07.383924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2859): Launched 09:51:07.703869 run osmo-msc_10.42.42.6(pid=2860): Launched 09:51:07.881449 run osmo-stp_10.42.42.5(pid=2857): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2857)] 09:51:08.015474 run osmo-stp_10.42.42.5(pid=2857): stdout: | (launched: 2022-12-13_09:51:06.656520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:08.150002 run osmo-stp_10.42.42.5(pid=2857): stderr: | 20221213095106848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095106848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095106848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095106848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095106851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095106851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095106851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:08.284347 run osmo-stp_10.42.42.5(pid=2857): stdout: | (launched: 2022-12-13_09:51:06.656520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:08.411640 run osmo-stp_10.42.42.5(pid=2857): stderr: | 20221213095106848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095106848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095106848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095106848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095106851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095106851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095106851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:08.564129 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2857): Process ended prematurely: osmo-stp_10.42.42.5(pid=2857) [trial-2387↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2857)] [trial-2387↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 09:51:08.573099 tst handover.py:18: Test FAILED (6.6 sec) 09:51:08.600213 run osmo-hlr_10.42.42.2(pid=2854): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2854)] 09:51:08.650758 run osmo-hlr_10.42.42.2(pid=2854): stdout: | (launched: 2022-12-13_09:51:05.697277) 09:51:08.702913 run osmo-hlr_10.42.42.2(pid=2854): stderr: | 20221213095105893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095105893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095105893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095105894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095105894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095105894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095105921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095105932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095105932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095105932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:08.774998 run osmo-msc_10.42.42.6(pid=2860): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2860)] 09:51:08.824487 run osmo-msc_10.42.42.6(pid=2860): stdout: | (launched: 2022-12-13_09:51:07.645906) 09:51:08.875957 run osmo-msc_10.42.42.6(pid=2860): stderr: | 20221213095107969 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095107969 DLGLOBAL DEBUG validating counter group 0x7f1002243c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095107969 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095107969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095107969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095107970 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095107971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095107972 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095107972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095107972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:08.927937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2853): Terminating (SIGTERM) 09:51:08.969339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2856): Terminating (SIGTERM) 09:51:09.010765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2859): Terminating (SIGTERM) 09:51:09.052310 --- ParallelTerminationStrategy: PID 2853 died... 09:51:09.072306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2853): Terminated: ok {rc=0} 09:51:09.118426 --- ParallelTerminationStrategy: PID 2856 died... 09:51:09.137967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2856): Terminated: ok {rc=0} 09:51:09.183998 --- ParallelTerminationStrategy: PID 2859 died... 09:51:09.203605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2859): Terminated: ok {rc=0} 09:51:09.289840 bus /sierra_3: Setting Powered False 09:51:10.387254 bus /sierra_3: Setting Powered False 09:51:11.500387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 09:51:12.765913 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:12.771382 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:51:12.808743 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:51:12.836170 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:51:12.888447 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:51:12.924485 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:51:12.951621 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:51:13.505572 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 09:51:13.511581 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:51:13.523203 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:51:13.558053 tst handover.py: using LAC 33147 09:51:13.683197 tst handover.py: using RAC 252 09:51:13.806586 tst handover.py: using CellId 33147 09:51:13.930262 tst handover.py: using BVCI 33148 09:51:14.046015 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:51:14.081076 tst handover.py: using LAC 33148 09:51:14.205675 tst handover.py: using RAC 253 09:51:14.329121 tst handover.py: using CellId 33148 09:51:14.453121 tst handover.py: using BVCI 33149 09:51:14.569226 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:51:14.580292 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:51:14.591290 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:51:14.602380 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:51:14.613954 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:51:14.625500 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:51:14.742113 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:51:14.859317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:15.299271 run create_hlr_db(pid=2865): Launched 09:51:15.415447 bus /sierra_2: Setting Powered False 09:51:16.478105 run create_hlr_db(pid=2865): Terminated: ok {rc=0} 09:51:16.908011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2867): Launched 09:51:17.243775 run osmo-hlr_10.42.42.2(pid=2868): Launched 09:51:17.365633 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:17.892498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2870): Launched 09:51:18.210415 run osmo-stp_10.42.42.5(pid=2871): Launched 09:51:18.331216 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:18.880632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2873): Launched 09:51:19.199568 run osmo-msc_10.42.42.6(pid=2874): Launched 09:51:19.378133 run osmo-stp_10.42.42.5(pid=2871): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2871)] 09:51:19.513655 run osmo-stp_10.42.42.5(pid=2871): stdout: | (launched: 2022-12-13_09:51:18.152620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:19.648255 run osmo-stp_10.42.42.5(pid=2871): stderr: | 20221213095118345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095118345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095118346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095118346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095118346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095118346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095118346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:19.782702 run osmo-stp_10.42.42.5(pid=2871): stdout: | (launched: 2022-12-13_09:51:18.152620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:19.909927 run osmo-stp_10.42.42.5(pid=2871): stderr: | 20221213095118345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095118345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095118346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095118346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095118346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095118346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095118346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:20.061978 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2871): Process ended prematurely: osmo-stp_10.42.42.5(pid=2871) [trial-2387↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2871)] [trial-2387↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 09:51:20.070933 tst handover.py:18: Test FAILED (6.6 sec) 09:51:20.098113 run osmo-hlr_10.42.42.2(pid=2868): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2868)] 09:51:20.147544 run osmo-hlr_10.42.42.2(pid=2868): stdout: | (launched: 2022-12-13_09:51:17.185884) 09:51:20.198839 run osmo-hlr_10.42.42.2(pid=2868): stderr: | 20221213095117383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095117383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095117383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095117383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095117383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095117383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095117396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095117404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095117404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095117404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:20.270358 run osmo-msc_10.42.42.6(pid=2874): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2874)] 09:51:20.319514 run osmo-msc_10.42.42.6(pid=2874): stdout: | (launched: 2022-12-13_09:51:19.141528) 09:51:20.370470 run osmo-msc_10.42.42.6(pid=2874): stderr: | 20221213095119464 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095119465 DLGLOBAL DEBUG validating counter group 0x7fe1a4e3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095119465 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095119465 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095119465 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095119465 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095119467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095119467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095119467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095119467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:20.421543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2867): Terminating (SIGTERM) 09:51:20.463358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2870): Terminating (SIGTERM) 09:51:20.505391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2873): Terminating (SIGTERM) 09:51:20.547175 --- ParallelTerminationStrategy: PID 2867 died... 09:51:20.566967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2867): Terminated: ok {rc=0} 09:51:20.612644 --- ParallelTerminationStrategy: PID 2870 died... 09:51:20.632077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2870): Terminated: ok {rc=0} 09:51:20.678068 --- ParallelTerminationStrategy: PID 2873 died... 09:51:20.697384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2873): Terminated: ok {rc=0} 09:51:20.783458 bus /sierra_3: Setting Powered False 09:51:21.880108 bus /sierra_3: Setting Powered False 09:51:22.995301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 09:51:24.240714 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:24.246385 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:51:24.297820 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:51:24.324891 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:51:24.377042 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:51:24.426605 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:51:24.452679 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:51:25.007059 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 09:51:25.013962 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:51:25.026160 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:51:25.060537 tst handover.py: using LAC 33149 09:51:25.178392 tst handover.py: using RAC 254 09:51:25.295004 tst handover.py: using CellId 33149 09:51:25.414925 tst handover.py: using BVCI 33150 09:51:25.522924 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:51:25.570491 tst handover.py: using LAC 33150 09:51:25.689654 tst handover.py: using RAC 255 09:51:25.806215 tst handover.py: using CellId 33150 09:51:25.925122 tst handover.py: using BVCI 33151 09:51:26.035159 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:51:26.046097 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:51:26.056728 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:51:26.067426 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:51:26.078773 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:51:26.089831 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:51:26.205787 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:51:26.326672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:26.793437 run create_hlr_db(pid=2879): Launched 09:51:26.923432 bus /sierra_2: Setting Powered False 09:51:27.986083 run create_hlr_db(pid=2879): Terminated: ok {rc=0} 09:51:28.401051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2881): Launched 09:51:28.718965 run osmo-hlr_10.42.42.2(pid=2882): Launched 09:51:28.840183 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:29.358698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2884): Launched 09:51:29.677184 run osmo-stp_10.42.42.5(pid=2885): Launched 09:51:29.798879 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:30.347825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2887): Launched 09:51:30.667160 run osmo-msc_10.42.42.6(pid=2888): Launched 09:51:30.844747 run osmo-stp_10.42.42.5(pid=2885): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2885)] 09:51:31.065853 run osmo-stp_10.42.42.5(pid=2885): stdout: | (launched: 2022-12-13_09:51:29.619427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:31.212590 run osmo-stp_10.42.42.5(pid=2885): stderr: | 20221213095129811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095129811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095129811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095129812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095129812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095129812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095129812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:31.385411 run osmo-stp_10.42.42.5(pid=2885): stdout: | (launched: 2022-12-13_09:51:29.619427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:31.578254 run osmo-stp_10.42.42.5(pid=2885): stderr: | 20221213095129811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095129811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095129811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095129812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095129812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095129812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095129812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:31.727788 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2885): Process ended prematurely: osmo-stp_10.42.42.5(pid=2885) [trial-2387↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2885)] [trial-2387↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 09:51:31.737161 tst handover.py:18: Test FAILED (6.7 sec) 09:51:31.764232 run osmo-hlr_10.42.42.2(pid=2882): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2882)] 09:51:31.816885 run osmo-hlr_10.42.42.2(pid=2882): stdout: | (launched: 2022-12-13_09:51:28.661290) 09:51:31.868932 run osmo-hlr_10.42.42.2(pid=2882): stderr: | 20221213095128858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095128858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095128858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095128858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095128858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095128858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095128869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095128878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095128878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095128878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:31.940619 run osmo-msc_10.42.42.6(pid=2888): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2888)] 09:51:31.989899 run osmo-msc_10.42.42.6(pid=2888): stdout: | (launched: 2022-12-13_09:51:30.608801) 09:51:32.043450 run osmo-msc_10.42.42.6(pid=2888): stderr: | 20221213095131003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095131003 DLGLOBAL DEBUG validating counter group 0x7fdb28caac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095131003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095131003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095131003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095131003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095131005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095131005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095131005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095131006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:32.094642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2881): Terminating (SIGTERM) 09:51:32.137376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2884): Terminating (SIGTERM) 09:51:32.180939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2887): Terminating (SIGTERM) 09:51:32.227013 --- ParallelTerminationStrategy: PID 2881 died... 09:51:32.248100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2881): Terminated: ok {rc=0} 09:51:32.295669 --- ParallelTerminationStrategy: PID 2884 died... 09:51:32.316319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2884): Terminated: ok {rc=0} 09:51:32.362698 --- ParallelTerminationStrategy: PID 2887 died... 09:51:32.383242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2887): Terminated: ok {rc=0} 09:51:32.472213 bus /sierra_3: Setting Powered False 09:51:33.569698 bus /sierra_3: Setting Powered False 09:51:34.684358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:51:35.940206 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:35.946269 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:51:35.993035 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:51:36.019297 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:51:36.071258 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:51:36.117498 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:51:36.143901 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:51:36.693145 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:51:36.698428 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:51:36.709497 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:51:36.742734 tst handover.py: using LAC 33151 09:51:36.869123 tst handover.py: using RAC 1 09:51:36.993979 tst handover.py: using CellId 33151 09:51:37.120756 tst handover.py: using BVCI 33152 09:51:37.236437 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:51:37.282402 tst handover.py: using LAC 33152 09:51:37.402429 tst handover.py: using RAC 2 09:51:37.520131 tst handover.py: using CellId 33152 09:51:37.639087 tst handover.py: using BVCI 33153 09:51:37.749985 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:51:37.761056 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:51:37.771925 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:51:37.782599 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:51:37.793745 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:51:37.804690 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:51:37.920154 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:51:38.038646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:38.478952 run create_hlr_db(pid=2893): Launched 09:51:38.593139 bus /sierra_2: Setting Powered False 09:51:39.652560 run create_hlr_db(pid=2893): Terminated: ok {rc=0} 09:51:40.062037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2895): Launched 09:51:40.382862 run osmo-hlr_10.42.42.2(pid=2896): Launched 09:51:40.505318 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:41.027864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2898): Launched 09:51:41.346861 run osmo-stp_10.42.42.5(pid=2899): Launched 09:51:41.469698 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:42.021770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2901): Launched 09:51:42.341244 run osmo-msc_10.42.42.6(pid=2902): Launched 09:51:42.520571 run osmo-stp_10.42.42.5(pid=2899): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2899)] 09:51:42.656560 run osmo-stp_10.42.42.5(pid=2899): stdout: | (launched: 2022-12-13_09:51:41.288738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:42.792222 run osmo-stp_10.42.42.5(pid=2899): stderr: | 20221213095141480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095141480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095141480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095141481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095141481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095141481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095141481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:42.927153 run osmo-stp_10.42.42.5(pid=2899): stdout: | (launched: 2022-12-13_09:51:41.288738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:43.054878 run osmo-stp_10.42.42.5(pid=2899): stderr: | 20221213095141480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095141480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095141480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095141481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095141481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095141481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095141481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:43.208823 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2899): Process ended prematurely: osmo-stp_10.42.42.5(pid=2899) [trial-2387↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2899)] [trial-2387↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 09:51:43.217911 tst handover.py:18: Test FAILED (6.5 sec) 09:51:43.245307 run osmo-hlr_10.42.42.2(pid=2896): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2896)] 09:51:43.295261 run osmo-hlr_10.42.42.2(pid=2896): stdout: | (launched: 2022-12-13_09:51:40.324647) 09:51:43.346811 run osmo-hlr_10.42.42.2(pid=2896): stderr: | 20221213095140522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095140522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095140522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095140522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095140522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095140522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095140534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095140542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095140542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095140542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:43.419135 run osmo-msc_10.42.42.6(pid=2902): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2902)] 09:51:43.469371 run osmo-msc_10.42.42.6(pid=2902): stdout: | (launched: 2022-12-13_09:51:42.283209) 09:51:43.520743 run osmo-msc_10.42.42.6(pid=2902): stderr: | 20221213095142605 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095142605 DLGLOBAL DEBUG validating counter group 0x7fe501990c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095142605 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095142605 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095142605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095142606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095142607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095142608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095142608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095142608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:43.572721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2895): Terminating (SIGTERM) 09:51:43.614469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2898): Terminating (SIGTERM) 09:51:43.655866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2901): Terminating (SIGTERM) 09:51:43.698132 --- ParallelTerminationStrategy: PID 2895 died... 09:51:43.718599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2895): Terminated: ok {rc=0} 09:51:43.764671 --- ParallelTerminationStrategy: PID 2898 died... 09:51:43.784354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2898): Terminated: ok {rc=0} 09:51:43.830414 --- ParallelTerminationStrategy: PID 2901 died... 09:51:43.850022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2901): Terminated: ok {rc=0} 09:51:43.937698 bus /sierra_3: Setting Powered False 09:51:45.034750 bus /sierra_3: Setting Powered False 09:51:46.149146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:51:47.402752 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:47.407789 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:51:47.458751 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:51:47.485052 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:51:47.536348 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:51:47.588531 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:51:47.615862 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:51:48.162946 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:51:48.169107 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:51:48.180400 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:51:48.214840 tst handover.py: using LAC 33153 09:51:48.341995 tst handover.py: using RAC 3 09:51:48.468662 tst handover.py: using CellId 33153 09:51:48.595602 tst handover.py: using BVCI 33154 09:51:48.711278 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:51:48.760765 tst handover.py: using LAC 33154 09:51:48.886775 tst handover.py: using RAC 4 09:51:49.012237 tst handover.py: using CellId 33154 09:51:49.139277 tst handover.py: using BVCI 33155 09:51:49.255591 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:51:49.266962 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:51:49.278109 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:51:49.289363 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:51:49.302977 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:51:49.314269 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:51:49.432333 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:51:49.550458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:49.990455 run create_hlr_db(pid=2907): Launched 09:51:50.105641 bus /sierra_2: Setting Powered False 09:51:51.165520 run create_hlr_db(pid=2907): Terminated: ok {rc=0} 09:51:51.574844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2909): Launched 09:51:51.895697 run osmo-hlr_10.42.42.2(pid=2910): Launched 09:51:52.017910 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:52.538912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2912): Launched 09:51:52.857313 run osmo-stp_10.42.42.5(pid=2913): Launched 09:51:52.979690 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:53.529982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2915): Launched 09:51:53.849129 run osmo-msc_10.42.42.6(pid=2916): Launched 09:51:54.026918 run osmo-stp_10.42.42.5(pid=2913): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2913)] 09:51:54.162251 run osmo-stp_10.42.42.5(pid=2913): stdout: | (launched: 2022-12-13_09:51:52.799481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:54.297975 run osmo-stp_10.42.42.5(pid=2913): stderr: | 20221213095152993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095152993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095152993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095152994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095152994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095152994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095152994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:54.432606 run osmo-stp_10.42.42.5(pid=2913): stdout: | (launched: 2022-12-13_09:51:52.799481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:54.560441 run osmo-stp_10.42.42.5(pid=2913): stderr: | 20221213095152993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095152993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095152993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095152994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095152994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095152994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095152994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:54.712328 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2913): Process ended prematurely: osmo-stp_10.42.42.5(pid=2913) [trial-2387↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2913)] [trial-2387↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 09:51:54.721196 tst handover.py:18: Test FAILED (6.5 sec) 09:51:54.748208 run osmo-hlr_10.42.42.2(pid=2910): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2910)] 09:51:54.798020 run osmo-hlr_10.42.42.2(pid=2910): stdout: | (launched: 2022-12-13_09:51:51.836697) 09:51:54.849664 run osmo-hlr_10.42.42.2(pid=2910): stderr: | 20221213095152035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095152035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095152035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095152035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095152035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095152035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095152047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095152055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095152055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095152055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:54.921514 run osmo-msc_10.42.42.6(pid=2916): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2916)] 09:51:54.971181 run osmo-msc_10.42.42.6(pid=2916): stdout: | (launched: 2022-12-13_09:51:53.791032) 09:51:55.022351 run osmo-msc_10.42.42.6(pid=2916): stderr: | 20221213095154111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095154111 DLGLOBAL DEBUG validating counter group 0x7fc727e93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095154111 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095154112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095154112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095154112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095154115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095154116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095154116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095154116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:55.074032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2909): Terminating (SIGTERM) 09:51:55.115272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2912): Terminating (SIGTERM) 09:51:55.156481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2915): Terminating (SIGTERM) 09:51:55.198031 --- ParallelTerminationStrategy: PID 2909 died... 09:51:55.217726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2909): Terminated: ok {rc=0} 09:51:55.263051 --- ParallelTerminationStrategy: PID 2912 died... 09:51:55.282405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2912): Terminated: ok {rc=0} 09:51:55.327844 --- ParallelTerminationStrategy: PID 2915 died... 09:51:55.347102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2915): Terminated: ok {rc=0} 09:51:55.434238 bus /sierra_3: Setting Powered False 09:51:56.531984 bus /sierra_3: Setting Powered False 09:51:57.647590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 09:51:58.907122 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:58.912817 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:51:58.951467 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:51:58.978686 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:51:59.031266 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:51:59.068719 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:51:59.095478 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:51:59.648068 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 09:51:59.653310 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:51:59.664414 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:51:59.700720 tst handover.py: using LAC 33155 09:51:59.823586 tst handover.py: using RAC 5 09:51:59.948764 tst handover.py: using CellId 33155 09:52:00.072052 tst handover.py: using BVCI 33156 09:52:00.187632 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:52:00.221962 tst handover.py: using LAC 33156 09:52:00.344830 tst handover.py: using RAC 6 09:52:00.471075 tst handover.py: using CellId 33156 09:52:00.596779 tst handover.py: using BVCI 33157 09:52:00.712196 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:52:00.723344 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:52:00.734442 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:52:00.745957 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:52:00.756920 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:52:00.768069 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:52:00.882761 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:52:01.018792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:01.517362 run create_hlr_db(pid=2921): Launched 09:52:01.684337 bus /sierra_2: Setting Powered False 09:52:02.744399 run create_hlr_db(pid=2921): Terminated: ok {rc=0} 09:52:03.135714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2923): Launched 09:52:03.434907 run osmo-hlr_10.42.42.2(pid=2924): Launched 09:52:03.548852 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:04.037281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2926): Launched 09:52:04.336458 run osmo-stp_10.42.42.5(pid=2927): Launched 09:52:04.450775 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:04.966489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2929): Launched 09:52:05.265341 run osmo-msc_10.42.42.6(pid=2930): Launched 09:52:05.433512 run osmo-stp_10.42.42.5(pid=2927): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2927)] 09:52:05.561559 run osmo-stp_10.42.42.5(pid=2927): stdout: | (launched: 2022-12-13_09:52:04.281800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:05.688477 run osmo-stp_10.42.42.5(pid=2927): stderr: | 20221213095204453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095204453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095204453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095204453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095204454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095204454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095204454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:05.813505 run osmo-stp_10.42.42.5(pid=2927): stdout: | (launched: 2022-12-13_09:52:04.281800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:05.933887 run osmo-stp_10.42.42.5(pid=2927): stderr: | 20221213095204453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095204453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095204453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095204453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095204454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095204454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095204454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:06.076593 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2927): Process ended prematurely: osmo-stp_10.42.42.5(pid=2927) [trial-2387↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2927)] [trial-2387↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 09:52:06.084805 tst handover.py:18: Test FAILED (6.4 sec) 09:52:06.110807 run osmo-hlr_10.42.42.2(pid=2924): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2924)] 09:52:06.159022 run osmo-hlr_10.42.42.2(pid=2924): stdout: | (launched: 2022-12-13_09:52:03.380426) 09:52:06.208751 run osmo-hlr_10.42.42.2(pid=2924): stderr: | 20221213095203555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095203555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095203555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095203555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095203555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095203555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095203567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095203576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095203576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095203577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:06.277492 run osmo-msc_10.42.42.6(pid=2930): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2930)] 09:52:06.324628 run osmo-msc_10.42.42.6(pid=2930): stdout: | (launched: 2022-12-13_09:52:05.210630) 09:52:06.373812 run osmo-msc_10.42.42.6(pid=2930): stderr: | 20221213095205481 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095205481 DLGLOBAL DEBUG validating counter group 0x7f73c1262c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095205482 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095205482 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095205482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095205482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095205484 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095205484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095205484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095205484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:06.423673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2923): Terminating (SIGTERM) 09:52:06.463380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2926): Terminating (SIGTERM) 09:52:06.503116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2929): Terminating (SIGTERM) 09:52:06.543064 --- ParallelTerminationStrategy: PID 2923 died... 09:52:06.562384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2923): Terminated: ok {rc=0} 09:52:06.606516 --- ParallelTerminationStrategy: PID 2926 died... 09:52:06.625264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2926): Terminated: ok {rc=0} 09:52:06.669081 --- ParallelTerminationStrategy: PID 2929 died... 09:52:06.687745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2929): Terminated: ok {rc=0} 09:52:06.772794 bus /sierra_3: Setting Powered False 09:52:07.871275 bus /sierra_3: Setting Powered False 09:52:08.986169 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 09:52:10.230555 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:10.236218 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:52:10.287391 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:52:10.314562 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:52:10.367688 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:52:10.418906 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:52:10.446120 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:52:10.998737 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 09:52:11.004179 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:52:11.015358 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:52:11.049797 tst handover.py: using LAC 33157 09:52:11.175359 tst handover.py: using RAC 7 09:52:11.300806 tst handover.py: using CellId 33157 09:52:11.426324 tst handover.py: using BVCI 33158 09:52:11.544204 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:52:11.593670 tst handover.py: using LAC 33158 09:52:11.720495 tst handover.py: using RAC 8 09:52:11.849163 tst handover.py: using CellId 33158 09:52:11.975265 tst handover.py: using BVCI 33159 09:52:12.092073 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:52:12.103303 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:52:12.114416 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:52:12.125469 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:52:12.137227 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:52:12.148737 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:52:12.263689 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:52:12.383640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:12.850842 run create_hlr_db(pid=2935): Launched 09:52:12.979635 bus /sierra_2: Setting Powered False 09:52:14.043561 run create_hlr_db(pid=2935): Terminated: ok {rc=0} 09:52:14.459111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2937): Launched 09:52:14.777440 run osmo-hlr_10.42.42.2(pid=2938): Launched 09:52:14.899348 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:15.421947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2940): Launched 09:52:15.739891 run osmo-stp_10.42.42.5(pid=2941): Launched 09:52:15.901797 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:16.565684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2943): Launched 09:52:16.902827 run osmo-msc_10.42.42.6(pid=2944): Launched 09:52:17.309592 run osmo-stp_10.42.42.5(pid=2941): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2941)] 09:52:17.504104 run osmo-stp_10.42.42.5(pid=2941): stdout: | (launched: 2022-12-13_09:52:15.682267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:17.631924 run osmo-stp_10.42.42.5(pid=2941): stderr: | 20221213095215920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095215920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095215923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095215924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095215927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095215927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095215927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:17.757673 run osmo-stp_10.42.42.5(pid=2941): stdout: | (launched: 2022-12-13_09:52:15.682267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:17.877403 run osmo-stp_10.42.42.5(pid=2941): stderr: | 20221213095215920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095215920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095215923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095215924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095215927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095215927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095215927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:18.021053 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2941): Process ended prematurely: osmo-stp_10.42.42.5(pid=2941) [trial-2387↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2941)] [trial-2387↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 09:52:18.029796 tst handover.py:18: Test FAILED (7.0 sec) 09:52:18.055828 run osmo-hlr_10.42.42.2(pid=2938): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2938)] 09:52:18.104856 run osmo-hlr_10.42.42.2(pid=2938): stdout: | (launched: 2022-12-13_09:52:14.719997) 09:52:18.155121 run osmo-hlr_10.42.42.2(pid=2938): stderr: | 20221213095214919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095214919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095214919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095214920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095214920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095214920 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095214935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095214944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095214945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095214945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:18.224743 run osmo-msc_10.42.42.6(pid=2944): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2944)] 09:52:18.272261 run osmo-msc_10.42.42.6(pid=2944): stdout: | (launched: 2022-12-13_09:52:16.840265) 09:52:18.321870 run osmo-msc_10.42.42.6(pid=2944): stderr: | 20221213095217250 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095217251 DLGLOBAL DEBUG validating counter group 0x7f276665bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095217251 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095217251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095217251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095217251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095217256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095217257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095217258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095217258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:18.371723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2937): Terminating (SIGTERM) 09:52:18.412155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2940): Terminating (SIGTERM) 09:52:18.452260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2943): Terminating (SIGTERM) 09:52:18.492729 --- ParallelTerminationStrategy: PID 2937 died... 09:52:18.512093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2937): Terminated: ok {rc=0} 09:52:18.556036 --- ParallelTerminationStrategy: PID 2940 died... 09:52:18.574931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2940): Terminated: ok {rc=0} 09:52:18.618805 --- ParallelTerminationStrategy: PID 2943 died... 09:52:18.638120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2943): Terminated: ok {rc=0} 09:52:18.723754 bus /sierra_3: Setting Powered False 09:52:19.821552 bus /sierra_3: Setting Powered False 09:52:20.935025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 09:52:22.200215 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:22.207071 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:52:22.258683 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:52:22.285896 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:52:22.336221 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:52:22.386517 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:52:22.413465 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:52:22.966073 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 09:52:22.971560 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:52:22.982916 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:52:23.017827 tst handover.py: using LAC 33159 09:52:23.136605 tst handover.py: using RAC 9 09:52:23.252486 tst handover.py: using CellId 33159 09:52:23.368754 tst handover.py: using BVCI 33160 09:52:23.477156 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:52:23.522999 tst handover.py: using LAC 33160 09:52:23.649383 tst handover.py: using RAC 10 09:52:23.773067 tst handover.py: using CellId 33160 09:52:23.897078 tst handover.py: using BVCI 33161 09:52:24.013175 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:52:24.024828 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:52:24.035957 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:52:24.046962 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:52:24.058683 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:52:24.070231 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:52:24.190365 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:52:24.305676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:24.744429 run create_hlr_db(pid=2949): Launched 09:52:24.860070 bus /sierra_2: Setting Powered False 09:52:25.919090 run create_hlr_db(pid=2949): Terminated: ok {rc=0} 09:52:26.312534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2951): Launched 09:52:26.611945 run osmo-hlr_10.42.42.2(pid=2952): Launched 09:52:26.726625 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:27.229638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2954): Launched 09:52:27.528120 run osmo-stp_10.42.42.5(pid=2955): Launched 09:52:27.642981 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:28.158404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2957): Launched 09:52:28.457197 run osmo-msc_10.42.42.6(pid=2958): Launched 09:52:28.624804 run osmo-stp_10.42.42.5(pid=2955): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2955)] 09:52:28.752798 run osmo-stp_10.42.42.5(pid=2955): stdout: | (launched: 2022-12-13_09:52:27.473559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:28.880219 run osmo-stp_10.42.42.5(pid=2955): stderr: | 20221213095227644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095227644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095227644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095227645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095227645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095227645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095227645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:29.005143 run osmo-stp_10.42.42.5(pid=2955): stdout: | (launched: 2022-12-13_09:52:27.473559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:29.124359 run osmo-stp_10.42.42.5(pid=2955): stderr: | 20221213095227644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095227644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095227644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095227645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095227645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095227645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095227645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:29.267028 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2955): Process ended prematurely: osmo-stp_10.42.42.5(pid=2955) [trial-2387↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2955)] [trial-2387↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 09:52:29.275554 tst handover.py:18: Test FAILED (6.3 sec) 09:52:29.301241 run osmo-hlr_10.42.42.2(pid=2952): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2952)] 09:52:29.349742 run osmo-hlr_10.42.42.2(pid=2952): stdout: | (launched: 2022-12-13_09:52:26.557326) 09:52:29.398767 run osmo-hlr_10.42.42.2(pid=2952): stderr: | 20221213095226734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095226734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095226734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095226734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095226734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095226734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095226746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095226755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095226755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095226755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:29.467253 run osmo-msc_10.42.42.6(pid=2958): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2958)] 09:52:29.514596 run osmo-msc_10.42.42.6(pid=2958): stdout: | (launched: 2022-12-13_09:52:28.402399) 09:52:29.563386 run osmo-msc_10.42.42.6(pid=2958): stderr: | 20221213095228674 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095228674 DLGLOBAL DEBUG validating counter group 0x7f21c1c3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095228674 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095228674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095228675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095228675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095228676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095228677 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095228677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095228677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:29.612305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2951): Terminating (SIGTERM) 09:52:29.651519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2954): Terminating (SIGTERM) 09:52:29.690850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2957): Terminating (SIGTERM) 09:52:29.730300 --- ParallelTerminationStrategy: PID 2951 died... 09:52:29.749459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2951): Terminated: ok {rc=0} 09:52:29.792923 --- ParallelTerminationStrategy: PID 2954 died... 09:52:29.811595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2954): Terminated: ok {rc=0} 09:52:29.854916 --- ParallelTerminationStrategy: PID 2957 died... 09:52:29.873434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2957): Terminated: ok {rc=0} 09:52:29.958174 bus /sierra_3: Setting Powered False 09:52:31.063832 bus /sierra_3: Setting Powered False 09:52:32.198364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 09:52:33.454088 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:33.460739 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:52:33.511207 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:52:33.538567 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:52:33.591780 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:52:33.641574 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:52:33.668909 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:52:34.215888 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 09:52:34.222646 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:52:34.236634 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:52:34.275332 tst handover.py: using LAC 33161 09:52:34.404553 tst handover.py: using RAC 11 09:52:34.529773 tst handover.py: using CellId 33161 09:52:34.653460 tst handover.py: using BVCI 33162 09:52:34.768885 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:52:34.816162 tst handover.py: using LAC 33162 09:52:34.941349 tst handover.py: using RAC 12 09:52:35.064642 tst handover.py: using CellId 33162 09:52:35.187458 tst handover.py: using BVCI 33163 09:52:35.303473 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:52:35.314889 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:52:35.325956 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:52:35.336891 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:52:35.348089 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:52:35.359197 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:52:35.480140 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:52:35.600143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:36.066498 run create_hlr_db(pid=2963): Launched 09:52:36.196714 bus /sierra_2: Setting Powered False 09:52:37.259958 run create_hlr_db(pid=2963): Terminated: ok {rc=0} 09:52:37.677297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2965): Launched 09:52:37.995778 run osmo-hlr_10.42.42.2(pid=2966): Launched 09:52:38.117629 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:38.642354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2968): Launched 09:52:38.959771 run osmo-stp_10.42.42.5(pid=2969): Launched 09:52:39.081240 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:39.634432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2971): Launched 09:52:39.954191 run osmo-msc_10.42.42.6(pid=2972): Launched 09:52:40.133335 run osmo-stp_10.42.42.5(pid=2969): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2969)] 09:52:40.269299 run osmo-stp_10.42.42.5(pid=2969): stdout: | (launched: 2022-12-13_09:52:38.902219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:40.404861 run osmo-stp_10.42.42.5(pid=2969): stderr: | 20221213095239097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095239097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095239097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095239098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095239098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095239098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095239098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:40.540085 run osmo-stp_10.42.42.5(pid=2969): stdout: | (launched: 2022-12-13_09:52:38.902219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:40.667705 run osmo-stp_10.42.42.5(pid=2969): stderr: | 20221213095239097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095239097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095239097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095239098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095239098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095239098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095239098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:40.820110 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2969): Process ended prematurely: osmo-stp_10.42.42.5(pid=2969) [trial-2387↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2969)] [trial-2387↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 09:52:40.829080 tst handover.py:18: Test FAILED (6.6 sec) 09:52:40.856030 run osmo-hlr_10.42.42.2(pid=2966): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2966)] 09:52:40.905768 run osmo-hlr_10.42.42.2(pid=2966): stdout: | (launched: 2022-12-13_09:52:37.938150) 09:52:40.956906 run osmo-hlr_10.42.42.2(pid=2966): stderr: | 20221213095238137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095238137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095238137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095238137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095238137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095238137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095238149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095238157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095238157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095238157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:41.028553 run osmo-msc_10.42.42.6(pid=2972): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2972)] 09:52:41.077840 run osmo-msc_10.42.42.6(pid=2972): stdout: | (launched: 2022-12-13_09:52:39.895806) 09:52:41.129165 run osmo-msc_10.42.42.6(pid=2972): stderr: | 20221213095240220 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095240220 DLGLOBAL DEBUG validating counter group 0x7fb4ebfa2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095240220 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095240221 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095240221 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095240221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095240223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095240223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095240223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095240223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:41.180508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2965): Terminating (SIGTERM) 09:52:41.221897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2968): Terminating (SIGTERM) 09:52:41.263232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2971): Terminating (SIGTERM) 09:52:41.304689 --- ParallelTerminationStrategy: PID 2965 died... 09:52:41.324524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2965): Terminated: ok {rc=0} 09:52:41.370307 --- ParallelTerminationStrategy: PID 2968 died... 09:52:41.389651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2968): Terminated: ok {rc=0} 09:52:41.435191 --- ParallelTerminationStrategy: PID 2971 died... 09:52:41.454599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2971): Terminated: ok {rc=0} 09:52:41.541200 bus /sierra_3: Setting Powered False 09:52:42.638795 bus /sierra_3: Setting Powered False 09:52:43.754300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:52:45.005115 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:45.010157 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:52:45.055353 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:52:45.081505 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:52:45.132498 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:52:45.176753 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:52:45.203004 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:52:45.754720 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:52:45.760265 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:52:45.771467 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:52:45.804217 tst handover.py: using LAC 33163 09:52:45.946057 tst handover.py: using RAC 13 09:52:46.074170 tst handover.py: using CellId 33163 09:52:46.202620 tst handover.py: using BVCI 33164 09:52:46.364496 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:52:46.419249 tst handover.py: using LAC 33164 09:52:46.541404 tst handover.py: using RAC 14 09:52:46.698196 tst handover.py: using CellId 33164 09:52:46.820491 tst handover.py: using BVCI 33165 09:52:46.974530 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:52:46.986925 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:52:46.999103 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:52:47.011474 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:52:47.024823 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:52:47.038318 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:52:47.178152 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:52:47.297246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:47.768627 run create_hlr_db(pid=2977): Launched 09:52:47.898822 bus /sierra_2: Setting Powered False 09:52:48.962051 run create_hlr_db(pid=2977): Terminated: ok {rc=0} 09:52:49.365196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2979): Launched 09:52:49.666631 run osmo-hlr_10.42.42.2(pid=2980): Launched 09:52:49.783037 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:50.287280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2982): Launched 09:52:50.585387 run osmo-stp_10.42.42.5(pid=2983): Launched 09:52:50.700364 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:51.216865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2985): Launched 09:52:51.516637 run osmo-msc_10.42.42.6(pid=2986): Launched 09:52:51.685131 run osmo-stp_10.42.42.5(pid=2983): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2983)] 09:52:51.812887 run osmo-stp_10.42.42.5(pid=2983): stdout: | (launched: 2022-12-13_09:52:50.531090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:51.940373 run osmo-stp_10.42.42.5(pid=2983): stderr: | 20221213095250701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095250701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095250701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095250702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095250702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095250702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095250702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:52.066250 run osmo-stp_10.42.42.5(pid=2983): stdout: | (launched: 2022-12-13_09:52:50.531090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:52.186552 run osmo-stp_10.42.42.5(pid=2983): stderr: | 20221213095250701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095250701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095250701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095250702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095250702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095250702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095250702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:52.330432 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2983): Process ended prematurely: osmo-stp_10.42.42.5(pid=2983) [trial-2387↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2983)] [trial-2387↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 09:52:52.338921 tst handover.py:18: Test FAILED (6.6 sec) 09:52:52.364888 run osmo-hlr_10.42.42.2(pid=2980): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2980)] 09:52:52.413125 run osmo-hlr_10.42.42.2(pid=2980): stdout: | (launched: 2022-12-13_09:52:49.611546) 09:52:52.462343 run osmo-hlr_10.42.42.2(pid=2980): stderr: | 20221213095249788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095249788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095249788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095249789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095249789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095249789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095249801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095249810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095249810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095249810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:52.531465 run osmo-msc_10.42.42.6(pid=2986): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2986)] 09:52:52.578593 run osmo-msc_10.42.42.6(pid=2986): stdout: | (launched: 2022-12-13_09:52:51.462096) 09:52:52.628373 run osmo-msc_10.42.42.6(pid=2986): stderr: | 20221213095251730 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095251731 DLGLOBAL DEBUG validating counter group 0x7fd72b2b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095251731 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095251731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095251731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095251731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095251733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095251733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095251734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095251734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:52.678288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2979): Terminating (SIGTERM) 09:52:52.718127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2982): Terminating (SIGTERM) 09:52:52.758226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2985): Terminating (SIGTERM) 09:52:52.798302 --- ParallelTerminationStrategy: PID 2979 died... 09:52:52.817824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2979): Terminated: ok {rc=0} 09:52:52.861965 --- ParallelTerminationStrategy: PID 2982 died... 09:52:52.881143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2982): Terminated: ok {rc=0} 09:52:52.925235 --- ParallelTerminationStrategy: PID 2985 died... 09:52:52.944194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2985): Terminated: ok {rc=0} 09:52:53.029638 bus /sierra_3: Setting Powered False 09:52:54.128036 bus /sierra_3: Setting Powered False 09:52:55.239710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:52:56.492391 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:56.497575 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:52:56.547333 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:52:56.573661 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:52:56.625234 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:52:56.675827 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:52:56.703163 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:52:57.251962 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:52:57.257346 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:52:57.268362 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:52:57.300942 tst handover.py: using LAC 33165 09:52:57.429072 tst handover.py: using RAC 15 09:52:57.555557 tst handover.py: using CellId 33165 09:52:57.681187 tst handover.py: using BVCI 33166 09:52:57.799203 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:52:57.849130 tst handover.py: using LAC 33166 09:52:57.975178 tst handover.py: using RAC 16 09:52:58.101906 tst handover.py: using CellId 33166 09:52:58.226509 tst handover.py: using BVCI 33167 09:52:58.345019 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:52:58.356451 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:52:58.367745 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:52:58.378953 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:52:58.390731 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:52:58.402428 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:52:58.520243 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:52:58.639803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:59.107569 run create_hlr_db(pid=2991): Launched 09:52:59.237501 bus /sierra_2: Setting Powered False 09:53:00.300847 run create_hlr_db(pid=2991): Terminated: ok {rc=0} 09:53:00.717260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2993): Launched 09:53:01.062604 run osmo-hlr_10.42.42.2(pid=2994): Launched 09:53:01.312678 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:01.902335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2996): Launched 09:53:02.257646 run osmo-stp_10.42.42.5(pid=2997): Launched 09:53:02.423079 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:02.980392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2999): Launched 09:53:03.299738 run osmo-msc_10.42.42.6(pid=3000): Launched 09:53:03.477755 run osmo-stp_10.42.42.5(pid=2997): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2997)] 09:53:03.613135 run osmo-stp_10.42.42.5(pid=2997): stdout: | (launched: 2022-12-13_09:53:02.190949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:03.748479 run osmo-stp_10.42.42.5(pid=2997): stderr: | 20221213095302474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095302474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095302475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095302475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095302475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095302475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095302475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:03.883292 run osmo-stp_10.42.42.5(pid=2997): stdout: | (launched: 2022-12-13_09:53:02.190949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:04.010661 run osmo-stp_10.42.42.5(pid=2997): stderr: | 20221213095302474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095302474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095302475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095302475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095302475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095302475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095302475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:04.163095 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2997): Process ended prematurely: osmo-stp_10.42.42.5(pid=2997) [trial-2387↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2997)] [trial-2387↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 09:53:04.171883 tst handover.py:18: Test FAILED (6.9 sec) 09:53:04.199060 run osmo-hlr_10.42.42.2(pid=2994): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2994)] 09:53:04.248481 run osmo-hlr_10.42.42.2(pid=2994): stdout: | (launched: 2022-12-13_09:53:00.993514) 09:53:04.299843 run osmo-hlr_10.42.42.2(pid=2994): stderr: | 20221213095301251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095301251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095301251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095301251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095301251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095301252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095301269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095301288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095301290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095301292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:04.372003 run osmo-msc_10.42.42.6(pid=3000): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3000)] 09:53:04.421513 run osmo-msc_10.42.42.6(pid=3000): stdout: | (launched: 2022-12-13_09:53:03.241819) 09:53:04.472619 run osmo-msc_10.42.42.6(pid=3000): stderr: | 20221213095303563 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095303564 DLGLOBAL DEBUG validating counter group 0x7f9c22b7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095303564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095303564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095303564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095303564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095303566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095303566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095303566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095303566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:04.524779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2993): Terminating (SIGTERM) 09:53:04.565960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2996): Terminating (SIGTERM) 09:53:04.607126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2999): Terminating (SIGTERM) 09:53:04.648796 --- ParallelTerminationStrategy: PID 2993 died... 09:53:04.668587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2993): Terminated: ok {rc=0} 09:53:04.714456 --- ParallelTerminationStrategy: PID 2996 died... 09:53:04.733844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2996): Terminated: ok {rc=0} 09:53:04.779357 --- ParallelTerminationStrategy: PID 2999 died... 09:53:04.798890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2999): Terminated: ok {rc=0} 09:53:04.885811 bus /sierra_3: Setting Powered False 09:53:05.983346 bus /sierra_3: Setting Powered False 09:53:07.097813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 09:53:08.352339 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:08.357248 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:53:08.393694 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:53:08.420545 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:53:08.472045 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:53:08.509736 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:53:08.536995 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:53:09.083304 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 09:53:09.088263 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:53:09.099001 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:53:09.131671 tst handover.py: using LAC 33167 09:53:09.249801 tst handover.py: using RAC 17 09:53:09.367350 tst handover.py: using CellId 33167 09:53:09.487618 tst handover.py: using BVCI 33168 09:53:09.606743 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:53:09.642368 tst handover.py: using LAC 33168 09:53:09.770292 tst handover.py: using RAC 18 09:53:09.896074 tst handover.py: using CellId 33168 09:53:10.022133 tst handover.py: using BVCI 33169 09:53:10.138994 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:53:10.150393 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:53:10.161483 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:53:10.172426 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:53:10.183719 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:53:10.195145 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:53:10.314411 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:53:10.433188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:10.900418 run create_hlr_db(pid=3005): Launched 09:53:11.030961 bus /sierra_2: Setting Powered False 09:53:12.094178 run create_hlr_db(pid=3005): Terminated: ok {rc=0} 09:53:12.495298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3007): Launched 09:53:12.794218 run osmo-hlr_10.42.42.2(pid=3008): Launched 09:53:12.907428 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:13.401086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3010): Launched 09:53:13.699824 run osmo-stp_10.42.42.5(pid=3011): Launched 09:53:13.813725 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:14.327197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3013): Launched 09:53:14.627146 run osmo-msc_10.42.42.6(pid=3014): Launched 09:53:14.794173 run osmo-stp_10.42.42.5(pid=3011): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3011)] 09:53:14.921511 run osmo-stp_10.42.42.5(pid=3011): stdout: | (launched: 2022-12-13_09:53:13.645338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:15.048493 run osmo-stp_10.42.42.5(pid=3011): stderr: | 20221213095313814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095313814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095313814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095313815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095313815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095313815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095313815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:15.173191 run osmo-stp_10.42.42.5(pid=3011): stdout: | (launched: 2022-12-13_09:53:13.645338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:15.292193 run osmo-stp_10.42.42.5(pid=3011): stderr: | 20221213095313814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095313814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095313814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095313815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095313815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095313815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095313815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:15.435154 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3011): Process ended prematurely: osmo-stp_10.42.42.5(pid=3011) [trial-2387↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3011)] [trial-2387↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 09:53:15.443286 tst handover.py:18: Test FAILED (6.3 sec) 09:53:15.469172 run osmo-hlr_10.42.42.2(pid=3008): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3008)] 09:53:15.517431 run osmo-hlr_10.42.42.2(pid=3008): stdout: | (launched: 2022-12-13_09:53:12.739942) 09:53:15.566681 run osmo-hlr_10.42.42.2(pid=3008): stderr: | 20221213095312915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095312915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095312915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095312915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095312915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095312915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095312928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095312938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095312938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095312938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:15.635414 run osmo-msc_10.42.42.6(pid=3014): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3014)] 09:53:15.682204 run osmo-msc_10.42.42.6(pid=3014): stdout: | (launched: 2022-12-13_09:53:14.571898) 09:53:15.731192 run osmo-msc_10.42.42.6(pid=3014): stderr: | 20221213095314841 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095314841 DLGLOBAL DEBUG validating counter group 0x7f38281d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095314841 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095314841 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095314842 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095314842 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095314843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095314844 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095314844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095314844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:15.780595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3007): Terminating (SIGTERM) 09:53:15.820022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3010): Terminating (SIGTERM) 09:53:15.865967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3013): Terminating (SIGTERM) 09:53:15.910438 --- ParallelTerminationStrategy: PID 3007 died... 09:53:15.936351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3007): Terminated: ok {rc=0} 09:53:15.984702 --- ParallelTerminationStrategy: PID 3010 died... 09:53:16.004828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3010): Terminated: ok {rc=0} 09:53:16.052768 --- ParallelTerminationStrategy: PID 3013 died... 09:53:16.073006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3013): Terminated: ok {rc=0} 09:53:16.161490 bus /sierra_3: Setting Powered False 09:53:17.258922 bus /sierra_3: Setting Powered False 09:53:18.377274 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 09:53:19.614953 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:19.620388 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:53:19.668756 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:53:19.695002 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:53:19.745488 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:53:19.793887 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:53:19.819885 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:53:20.369617 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 09:53:20.376904 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:53:20.388822 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:53:20.423426 tst handover.py: using LAC 33169 09:53:20.542322 tst handover.py: using RAC 19 09:53:20.665057 tst handover.py: using CellId 33169 09:53:20.794377 tst handover.py: using BVCI 33170 09:53:20.913316 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:53:20.961672 tst handover.py: using LAC 33170 09:53:21.087695 tst handover.py: using RAC 20 09:53:21.205545 tst handover.py: using CellId 33170 09:53:21.324116 tst handover.py: using BVCI 33171 09:53:21.433086 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:53:21.443988 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:53:21.454609 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:53:21.465603 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:53:21.476502 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:53:21.487870 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:53:21.603303 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:53:21.721847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:22.162550 run create_hlr_db(pid=3019): Launched 09:53:22.276627 bus /sierra_2: Setting Powered False 09:53:23.337159 run create_hlr_db(pid=3019): Terminated: ok {rc=0} 09:53:23.729192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3021): Launched 09:53:24.029408 run osmo-hlr_10.42.42.2(pid=3022): Launched 09:53:24.143464 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:24.646760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3024): Launched 09:53:24.944269 run osmo-stp_10.42.42.5(pid=3025): Launched 09:53:25.059539 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:25.575343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3027): Launched 09:53:25.874623 run osmo-msc_10.42.42.6(pid=3028): Launched 09:53:26.041948 run osmo-stp_10.42.42.5(pid=3025): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3025)] 09:53:26.169543 run osmo-stp_10.42.42.5(pid=3025): stdout: | (launched: 2022-12-13_09:53:24.889841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:26.296893 run osmo-stp_10.42.42.5(pid=3025): stderr: | 20221213095325061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095325061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095325061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095325062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095325062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095325062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095325062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:26.421933 run osmo-stp_10.42.42.5(pid=3025): stdout: | (launched: 2022-12-13_09:53:24.889841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:26.542345 run osmo-stp_10.42.42.5(pid=3025): stderr: | 20221213095325061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095325061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095325061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095325062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095325062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095325062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095325062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:26.685752 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3025): Process ended prematurely: osmo-stp_10.42.42.5(pid=3025) [trial-2387↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3025)] [trial-2387↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 09:53:26.694266 tst handover.py:18: Test FAILED (6.3 sec) 09:53:26.720166 run osmo-hlr_10.42.42.2(pid=3022): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3022)] 09:53:26.768670 run osmo-hlr_10.42.42.2(pid=3022): stdout: | (launched: 2022-12-13_09:53:23.973888) 09:53:26.818290 run osmo-hlr_10.42.42.2(pid=3022): stderr: | 20221213095324151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095324151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095324151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095324151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095324151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095324151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095324163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095324172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095324172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095324172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:26.887623 run osmo-msc_10.42.42.6(pid=3028): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3028)] 09:53:26.935140 run osmo-msc_10.42.42.6(pid=3028): stdout: | (launched: 2022-12-13_09:53:25.819846) 09:53:26.984534 run osmo-msc_10.42.42.6(pid=3028): stderr: | 20221213095326088 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095326089 DLGLOBAL DEBUG validating counter group 0x7f35d573dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095326089 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095326089 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095326089 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095326089 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095326091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095326091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095326091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095326091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:27.034481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3021): Terminating (SIGTERM) 09:53:27.074414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3024): Terminating (SIGTERM) 09:53:27.114439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3027): Terminating (SIGTERM) 09:53:27.154445 --- ParallelTerminationStrategy: PID 3021 died... 09:53:27.173922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3021): Terminated: ok {rc=0} 09:53:27.218497 --- ParallelTerminationStrategy: PID 3024 died... 09:53:27.237764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3024): Terminated: ok {rc=0} 09:53:27.281762 --- ParallelTerminationStrategy: PID 3027 died... 09:53:27.300755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3027): Terminated: ok {rc=0} 09:53:27.383844 bus /sierra_3: Setting Powered False 09:53:28.480931 bus /sierra_3: Setting Powered False 09:53:29.596353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 09:53:30.856234 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:30.862650 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:53:30.913904 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:53:30.941729 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:53:30.997142 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:53:31.059931 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:53:31.087721 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:53:31.641356 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 09:53:31.648257 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:53:31.662945 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:53:31.702591 tst handover.py: using LAC 33171 09:53:31.847192 tst handover.py: using RAC 21 09:53:31.967428 tst handover.py: using CellId 33171 09:53:32.123036 tst handover.py: using BVCI 33172 09:53:32.235803 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:53:32.283235 tst handover.py: using LAC 33172 09:53:32.404923 tst handover.py: using RAC 22 09:53:32.524482 tst handover.py: using CellId 33172 09:53:32.642049 tst handover.py: using BVCI 33173 09:53:32.752670 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:53:32.763691 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:53:32.774344 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:53:32.784918 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:53:32.795999 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:53:32.807118 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:53:32.921864 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:53:33.045125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:33.512941 run create_hlr_db(pid=3033): Launched 09:53:33.645125 bus /sierra_2: Setting Powered False 09:53:34.708236 run create_hlr_db(pid=3033): Terminated: ok {rc=0} 09:53:35.125079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3035): Launched 09:53:35.444124 run osmo-hlr_10.42.42.2(pid=3036): Launched 09:53:35.567295 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:36.088382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3038): Launched 09:53:36.405823 run osmo-stp_10.42.42.5(pid=3039): Launched 09:53:36.527946 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:37.079321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3041): Launched 09:53:37.398310 run osmo-msc_10.42.42.6(pid=3042): Launched 09:53:37.577118 run osmo-stp_10.42.42.5(pid=3039): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3039)] 09:53:37.712323 run osmo-stp_10.42.42.5(pid=3039): stdout: | (launched: 2022-12-13_09:53:36.348236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:37.847593 run osmo-stp_10.42.42.5(pid=3039): stderr: | 20221213095336539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095336539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095336539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095336540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095336542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095336542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095336542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:37.982441 run osmo-stp_10.42.42.5(pid=3039): stdout: | (launched: 2022-12-13_09:53:36.348236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:38.110130 run osmo-stp_10.42.42.5(pid=3039): stderr: | 20221213095336539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095336539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095336539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095336540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095336542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095336542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095336542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:38.262587 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3039): Process ended prematurely: osmo-stp_10.42.42.5(pid=3039) [trial-2387↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3039)] [trial-2387↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 09:53:38.271328 tst handover.py:18: Test FAILED (6.6 sec) 09:53:38.298432 run osmo-hlr_10.42.42.2(pid=3036): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3036)] 09:53:38.348407 run osmo-hlr_10.42.42.2(pid=3036): stdout: | (launched: 2022-12-13_09:53:35.386519) 09:53:38.399609 run osmo-hlr_10.42.42.2(pid=3036): stderr: | 20221213095335585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095335585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095335585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095335585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095335585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095335585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095335619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095335630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095335630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095335630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:38.471069 run osmo-msc_10.42.42.6(pid=3042): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3042)] 09:53:38.520413 run osmo-msc_10.42.42.6(pid=3042): stdout: | (launched: 2022-12-13_09:53:37.340582) 09:53:38.571508 run osmo-msc_10.42.42.6(pid=3042): stderr: | 20221213095337662 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095337663 DLGLOBAL DEBUG validating counter group 0x7ff27b854c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095337663 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095337663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095337663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095337663 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095337665 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095337665 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095337665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095337665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:38.623103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3035): Terminating (SIGTERM) 09:53:38.664216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3038): Terminating (SIGTERM) 09:53:38.705415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3041): Terminating (SIGTERM) 09:53:38.746770 --- ParallelTerminationStrategy: PID 3035 died... 09:53:38.766582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3035): Terminated: ok {rc=0} 09:53:38.812018 --- ParallelTerminationStrategy: PID 3038 died... 09:53:38.831300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3038): Terminated: ok {rc=0} 09:53:38.876567 --- ParallelTerminationStrategy: PID 3041 died... 09:53:38.895871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3041): Terminated: ok {rc=0} 09:53:38.982334 bus /sierra_3: Setting Powered False 09:53:40.079609 bus /sierra_3: Setting Powered False 09:53:41.193738 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:53:42.452191 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:42.458843 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:53:42.519019 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:53:42.546760 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:53:42.597650 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:53:42.657869 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:53:42.685030 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:53:43.240343 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:53:43.246757 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:53:43.258342 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:53:43.313836 tst handover.py: using LAC 33173 09:53:43.432173 tst handover.py: using RAC 23 09:53:43.551500 tst handover.py: using CellId 33173 09:53:43.669561 tst handover.py: using BVCI 33174 09:53:43.777580 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:53:43.819743 tst handover.py: using LAC 33174 09:53:43.936195 tst handover.py: using RAC 24 09:53:44.052219 tst handover.py: using CellId 33174 09:53:44.168524 tst handover.py: using BVCI 33175 09:53:44.277104 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:53:44.288150 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:53:44.299185 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:53:44.310156 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:53:44.321416 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:53:44.332556 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:53:44.453087 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:53:44.568798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:45.007699 run create_hlr_db(pid=3047): Launched 09:53:45.121917 bus /sierra_2: Setting Powered False 09:53:46.187018 run create_hlr_db(pid=3047): Terminated: ok {rc=0} 09:53:46.618007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3049): Launched 09:53:46.979967 run osmo-hlr_10.42.42.2(pid=3065): Launched 09:53:47.257138 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:48.013711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3116): Launched 09:53:48.398018 run osmo-stp_10.42.42.5(pid=3153): Launched 09:53:48.683023 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:49.437410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3290): Launched 09:53:49.846211 run osmo-msc_10.42.42.6(pid=3325): Launched 09:53:50.209996 run osmo-stp_10.42.42.5(pid=3153): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3153)] 09:53:50.423623 run osmo-stp_10.42.42.5(pid=3153): stdout: | (launched: 2022-12-13_09:53:48.322739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:50.611627 run osmo-stp_10.42.42.5(pid=3153): stderr: | 20221213095348664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095348664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095348664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095348674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095348675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095348675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095348675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:50.750876 run osmo-stp_10.42.42.5(pid=3153): stdout: | (launched: 2022-12-13_09:53:48.322739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:50.882362 run osmo-stp_10.42.42.5(pid=3153): stderr: | 20221213095348664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095348664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095348664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095348674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095348675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095348675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095348675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:51.038485 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3153): Process ended prematurely: osmo-stp_10.42.42.5(pid=3153) [trial-2387↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3153)] [trial-2387↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 09:53:51.048361 tst handover.py:18: Test FAILED (7.8 sec) 09:53:51.077019 run osmo-hlr_10.42.42.2(pid=3065): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3065)] 09:53:51.128836 run osmo-hlr_10.42.42.2(pid=3065): stdout: | (launched: 2022-12-13_09:53:46.907797) 09:53:51.182217 run osmo-hlr_10.42.42.2(pid=3065): stderr: | 20221213095347243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095347243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095347243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095347243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095347243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095347243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095347291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095347303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095347304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095347304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:51.257266 run osmo-msc_10.42.42.6(pid=3325): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3325)] 09:53:51.308459 run osmo-msc_10.42.42.6(pid=3325): stdout: | (launched: 2022-12-13_09:53:49.770238) 09:53:51.362034 run osmo-msc_10.42.42.6(pid=3325): stderr: | 20221213095350196 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095350196 DLGLOBAL DEBUG validating counter group 0x7fcde44f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095350196 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095350196 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095350196 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095350196 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095350210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095350211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095350211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095350211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:51.415360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3049): Terminating (SIGTERM) 09:53:51.459597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3116): Terminating (SIGTERM) 09:53:51.504321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3290): Terminating (SIGTERM) 09:53:51.550215 --- ParallelTerminationStrategy: PID 3049 died... 09:53:51.570991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3049): Terminated: ok {rc=0} 09:53:51.620519 --- ParallelTerminationStrategy: PID 3116 died... 09:53:51.642141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3116): Terminated: ok {rc=0} 09:53:51.689425 --- ParallelTerminationStrategy: PID 3290 died... 09:53:51.709483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3290): Terminated: ok {rc=0} 09:53:51.797196 bus /sierra_3: Setting Powered False 09:53:52.899585 bus /sierra_3: Setting Powered False 09:53:54.018017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:53:55.289531 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:55.295483 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:53:55.363405 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:53:55.391013 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:53:55.445685 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:53:55.510965 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:53:55.538821 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:53:56.092119 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:53:56.099056 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:53:56.111103 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:53:56.165824 tst handover.py: using LAC 33175 09:53:56.291020 tst handover.py: using RAC 25 09:53:56.412030 tst handover.py: using CellId 33175 09:53:56.533406 tst handover.py: using BVCI 33176 09:53:56.647543 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:53:56.695504 tst handover.py: using LAC 33176 09:53:56.815769 tst handover.py: using RAC 26 09:53:56.939667 tst handover.py: using CellId 33176 09:53:57.063144 tst handover.py: using BVCI 33177 09:53:57.176467 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:53:57.188774 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:53:57.201148 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:53:57.212899 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:53:57.226564 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:53:57.240233 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:53:57.363621 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:53:57.487910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:57.948749 run create_hlr_db(pid=3332): Launched 09:53:58.108638 bus /sierra_2: Setting Powered False 09:53:59.173624 run create_hlr_db(pid=3332): Terminated: ok {rc=0} 09:53:59.607903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3334): Launched 09:53:59.950562 run osmo-hlr_10.42.42.2(pid=3335): Launched 09:54:00.196694 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:00.840187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3337): Launched 09:54:01.210021 run osmo-stp_10.42.42.5(pid=3338): Launched 09:54:01.478468 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:02.241605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3340): Launched 09:54:02.647841 run osmo-msc_10.42.42.6(pid=3341): Launched 09:54:03.013189 run osmo-stp_10.42.42.5(pid=3338): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3338)] 09:54:03.240868 run osmo-stp_10.42.42.5(pid=3338): stdout: | (launched: 2022-12-13_09:54:01.150892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:03.529598 run osmo-stp_10.42.42.5(pid=3338): stderr: | 20221213095401407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095401407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095401407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095401408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095401412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095401412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095401412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:03.676010 run osmo-stp_10.42.42.5(pid=3338): stdout: | (launched: 2022-12-13_09:54:01.150892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:03.805929 run osmo-stp_10.42.42.5(pid=3338): stderr: | 20221213095401407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095401407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095401407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095401408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095401412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095401412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095401412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:03.963085 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3338): Process ended prematurely: osmo-stp_10.42.42.5(pid=3338) [trial-2387↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3338)] [trial-2387↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 09:54:03.972832 tst handover.py:18: Test FAILED (7.9 sec) 09:54:04.002148 run osmo-hlr_10.42.42.2(pid=3335): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3335)] 09:54:04.054778 run osmo-hlr_10.42.42.2(pid=3335): stdout: | (launched: 2022-12-13_09:53:59.887050) 09:54:04.108071 run osmo-hlr_10.42.42.2(pid=3335): stderr: | 20221213095400197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095400197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095400197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095400197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095400197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095400197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095400222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095400236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095400236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095400236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:04.182478 run osmo-msc_10.42.42.6(pid=3341): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3341)] 09:54:04.233920 run osmo-msc_10.42.42.6(pid=3341): stdout: | (launched: 2022-12-13_09:54:02.575076) 09:54:04.287895 run osmo-msc_10.42.42.6(pid=3341): stderr: | 20221213095403182 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095403182 DLGLOBAL DEBUG validating counter group 0x7f54391fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095403183 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095403183 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095403183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095403183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095403193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095403193 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095403193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095403194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:04.341913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3334): Terminating (SIGTERM) 09:54:04.385959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3337): Terminating (SIGTERM) 09:54:04.431192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3340): Terminating (SIGTERM) 09:54:04.478110 --- ParallelTerminationStrategy: PID 3334 died... 09:54:04.498806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3334): Terminated: ok {rc=0} 09:54:04.548392 --- ParallelTerminationStrategy: PID 3337 died... 09:54:04.569137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3337): Terminated: ok {rc=0} 09:54:04.617279 --- ParallelTerminationStrategy: PID 3340 died... 09:54:04.638281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3340): Terminated: ok {rc=0} 09:54:04.729761 bus /sierra_3: Setting Powered False 09:54:05.832399 bus /sierra_3: Setting Powered False 09:54:06.954537 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 09:54:08.230138 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:08.236013 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:54:08.291747 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:54:08.319553 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:54:08.375207 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:54:08.427467 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:54:08.456691 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:54:09.008731 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 09:54:09.015740 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:09.028010 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:54:09.081927 tst handover.py: using LAC 33177 09:54:09.212226 tst handover.py: using RAC 27 09:54:09.344568 tst handover.py: using CellId 33177 09:54:09.474393 tst handover.py: using BVCI 33178 09:54:09.598257 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:54:09.634660 tst handover.py: using LAC 33178 09:54:09.767495 tst handover.py: using RAC 28 09:54:09.898998 tst handover.py: using CellId 33178 09:54:10.028432 tst handover.py: using BVCI 33179 09:54:10.150355 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:10.162650 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:10.174737 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:10.187160 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:10.199990 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:10.213341 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:54:10.339318 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:54:10.464010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:10.957549 run create_hlr_db(pid=3346): Launched 09:54:11.087579 bus /sierra_2: Setting Powered False 09:54:12.151845 run create_hlr_db(pid=3346): Terminated: ok {rc=0} 09:54:12.554251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3348): Launched 09:54:12.853386 run osmo-hlr_10.42.42.2(pid=3349): Launched 09:54:12.969213 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:13.476342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3351): Launched 09:54:13.776560 run osmo-stp_10.42.42.5(pid=3352): Launched 09:54:13.891717 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:14.421576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3354): Launched 09:54:14.721528 run osmo-msc_10.42.42.6(pid=3355): Launched 09:54:14.890820 run osmo-stp_10.42.42.5(pid=3352): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3352)] 09:54:15.019621 run osmo-stp_10.42.42.5(pid=3352): stdout: | (launched: 2022-12-13_09:54:13.721658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:15.147761 run osmo-stp_10.42.42.5(pid=3352): stderr: | 20221213095413891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095413891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095413891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095413892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095413892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095413892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095413892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:15.273333 run osmo-stp_10.42.42.5(pid=3352): stdout: | (launched: 2022-12-13_09:54:13.721658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:15.392537 run osmo-stp_10.42.42.5(pid=3352): stderr: | 20221213095413891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095413891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095413891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095413892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095413892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095413892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095413892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:15.535519 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3352): Process ended prematurely: osmo-stp_10.42.42.5(pid=3352) [trial-2387↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3352)] [trial-2387↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 09:54:15.543787 tst handover.py:18: Test FAILED (6.5 sec) 09:54:15.569975 run osmo-hlr_10.42.42.2(pid=3349): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3349)] 09:54:15.618827 run osmo-hlr_10.42.42.2(pid=3349): stdout: | (launched: 2022-12-13_09:54:12.798517) 09:54:15.669243 run osmo-hlr_10.42.42.2(pid=3349): stderr: | 20221213095412972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095412972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095412972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095412972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095412972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095412972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095412985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095412993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095412994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095412994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:15.739115 run osmo-msc_10.42.42.6(pid=3355): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3355)] 09:54:15.786864 run osmo-msc_10.42.42.6(pid=3355): stdout: | (launched: 2022-12-13_09:54:14.666710) 09:54:15.836393 run osmo-msc_10.42.42.6(pid=3355): stderr: | 20221213095414937 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095414938 DLGLOBAL DEBUG validating counter group 0x7f6b9ee58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095414938 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095414938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095414938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095414938 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095414940 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095414940 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095414940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095414941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:15.894108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3348): Terminating (SIGTERM) 09:54:15.937205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3351): Terminating (SIGTERM) 09:54:15.982749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3354): Terminating (SIGTERM) 09:54:16.027698 --- ParallelTerminationStrategy: PID 3348 died... 09:54:16.049396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3348): Terminated: ok {rc=0} 09:54:16.098820 --- ParallelTerminationStrategy: PID 3351 died... 09:54:16.119048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3351): Terminated: ok {rc=0} 09:54:16.166571 --- ParallelTerminationStrategy: PID 3354 died... 09:54:16.187027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3354): Terminated: ok {rc=0} 09:54:16.278846 bus /sierra_3: Setting Powered False 09:54:17.386430 bus /sierra_3: Setting Powered False 09:54:18.501466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 09:54:19.752323 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:19.757467 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:54:19.819369 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:54:19.845644 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:54:19.896376 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:54:19.959044 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:54:19.985668 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:54:20.534895 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 09:54:20.540468 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:54:20.551350 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:54:20.601638 tst handover.py: using LAC 33179 09:54:20.719325 tst handover.py: using RAC 29 09:54:20.835699 tst handover.py: using CellId 33179 09:54:20.951805 tst handover.py: using BVCI 33180 09:54:21.069155 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:54:21.117205 tst handover.py: using LAC 33180 09:54:21.241706 tst handover.py: using RAC 30 09:54:21.365805 tst handover.py: using CellId 33180 09:54:21.491158 tst handover.py: using BVCI 33181 09:54:21.609601 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:54:21.620829 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:54:21.631866 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:54:21.642974 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:54:21.655024 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:54:21.666605 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:54:21.787478 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:54:21.905769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:22.373725 run create_hlr_db(pid=3360): Launched 09:54:22.502428 bus /sierra_2: Setting Powered False 09:54:23.565844 run create_hlr_db(pid=3360): Terminated: ok {rc=0} 09:54:23.966360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3362): Launched 09:54:24.265322 run osmo-hlr_10.42.42.2(pid=3363): Launched 09:54:24.380401 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:24.884040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3365): Launched 09:54:25.184783 run osmo-stp_10.42.42.5(pid=3366): Launched 09:54:25.299903 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:25.819819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3368): Launched 09:54:26.120079 run osmo-msc_10.42.42.6(pid=3369): Launched 09:54:26.288664 run osmo-stp_10.42.42.5(pid=3366): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3366)] 09:54:26.417853 run osmo-stp_10.42.42.5(pid=3366): stdout: | (launched: 2022-12-13_09:54:25.129863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:26.545229 run osmo-stp_10.42.42.5(pid=3366): stderr: | 20221213095425301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095425301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095425302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095425302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095425302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095425302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095425303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:26.671227 run osmo-stp_10.42.42.5(pid=3366): stdout: | (launched: 2022-12-13_09:54:25.129863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:26.790924 run osmo-stp_10.42.42.5(pid=3366): stderr: | 20221213095425301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095425301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095425302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095425302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095425302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095425302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095425303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:26.934474 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3366): Process ended prematurely: osmo-stp_10.42.42.5(pid=3366) [trial-2387↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3366)] [trial-2387↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 09:54:26.942769 tst handover.py:18: Test FAILED (6.4 sec) 09:54:26.968757 run osmo-hlr_10.42.42.2(pid=3363): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3363)] 09:54:27.017484 run osmo-hlr_10.42.42.2(pid=3363): stdout: | (launched: 2022-12-13_09:54:24.210880) 09:54:27.067573 run osmo-hlr_10.42.42.2(pid=3363): stderr: | 20221213095424388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095424388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095424388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095424388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095424388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095424388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095424400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095424409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095424409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095424409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:27.137196 run osmo-msc_10.42.42.6(pid=3369): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3369)] 09:54:27.184763 run osmo-msc_10.42.42.6(pid=3369): stdout: | (launched: 2022-12-13_09:54:26.065136) 09:54:27.234597 run osmo-msc_10.42.42.6(pid=3369): stderr: | 20221213095426335 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095426336 DLGLOBAL DEBUG validating counter group 0x7f8679aabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095426336 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095426336 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095426336 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095426336 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095426340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095426340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095426340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095426340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:27.284487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3362): Terminating (SIGTERM) 09:54:27.323923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3365): Terminating (SIGTERM) 09:54:27.363716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3368): Terminating (SIGTERM) 09:54:27.403756 --- ParallelTerminationStrategy: PID 3362 died... 09:54:27.423391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3362): Terminated: ok {rc=0} 09:54:27.467772 --- ParallelTerminationStrategy: PID 3365 died... 09:54:27.487022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3365): Terminated: ok {rc=0} 09:54:27.531160 --- ParallelTerminationStrategy: PID 3368 died... 09:54:27.550325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3368): Terminated: ok {rc=0} 09:54:27.636349 bus /sierra_3: Setting Powered False 09:54:28.734773 bus /sierra_3: Setting Powered False 09:54:29.847497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 09:54:31.136581 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:31.143605 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:54:31.223667 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:54:31.251168 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:54:31.305675 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:54:31.385273 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:54:31.417923 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:54:31.989910 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 09:54:31.998130 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:54:32.012831 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:54:32.070303 tst handover.py: using LAC 33181 09:54:32.229967 tst handover.py: using RAC 31 09:54:32.359694 tst handover.py: using CellId 33181 09:54:32.486706 tst handover.py: using BVCI 33182 09:54:32.605514 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:54:32.653901 tst handover.py: using LAC 33182 09:54:32.779065 tst handover.py: using RAC 32 09:54:32.898781 tst handover.py: using CellId 33182 09:54:33.018406 tst handover.py: using BVCI 33183 09:54:33.129265 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:54:33.140106 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:54:33.150924 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:54:33.161691 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:54:33.172929 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:54:33.184517 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:54:33.303855 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:54:33.420366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:33.890225 run create_hlr_db(pid=3375): Launched 09:54:34.020335 bus /sierra_2: Setting Powered False 09:54:35.084642 run create_hlr_db(pid=3375): Terminated: ok {rc=0} 09:54:35.500685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3377): Launched 09:54:35.819692 run osmo-hlr_10.42.42.2(pid=3378): Launched 09:54:35.941834 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:36.469346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3380): Launched 09:54:36.789155 run osmo-stp_10.42.42.5(pid=3381): Launched 09:54:36.912070 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:37.466281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3383): Launched 09:54:37.785387 run osmo-msc_10.42.42.6(pid=3384): Launched 09:54:37.964776 run osmo-stp_10.42.42.5(pid=3381): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3381)] 09:54:38.100431 run osmo-stp_10.42.42.5(pid=3381): stdout: | (launched: 2022-12-13_09:54:36.731001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:38.236214 run osmo-stp_10.42.42.5(pid=3381): stderr: | 20221213095436923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095436923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095436923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095436923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095436924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095436924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095436924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:38.371402 run osmo-stp_10.42.42.5(pid=3381): stdout: | (launched: 2022-12-13_09:54:36.731001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:38.499016 run osmo-stp_10.42.42.5(pid=3381): stderr: | 20221213095436923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095436923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095436923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095436923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095436924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095436924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095436924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:38.652353 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3381): Process ended prematurely: osmo-stp_10.42.42.5(pid=3381) [trial-2387↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3381)] [trial-2387↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 09:54:38.661492 tst handover.py:18: Test FAILED (6.7 sec) 09:54:38.688670 run osmo-hlr_10.42.42.2(pid=3378): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3378)] 09:54:38.738838 run osmo-hlr_10.42.42.2(pid=3378): stdout: | (launched: 2022-12-13_09:54:35.761719) 09:54:38.791053 run osmo-hlr_10.42.42.2(pid=3378): stderr: | 20221213095435960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095435960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095435960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095435960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095435960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095435960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095435972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095435980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095435980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095435981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:38.863486 run osmo-msc_10.42.42.6(pid=3384): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3384)] 09:54:38.913335 run osmo-msc_10.42.42.6(pid=3384): stdout: | (launched: 2022-12-13_09:54:37.727337) 09:54:38.965169 run osmo-msc_10.42.42.6(pid=3384): stderr: | 20221213095438051 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095438051 DLGLOBAL DEBUG validating counter group 0x7f93ec998c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095438051 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095438051 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095438052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095438052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095438054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095438054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095438054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095438054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:39.017325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3377): Terminating (SIGTERM) 09:54:39.058924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3380): Terminating (SIGTERM) 09:54:39.101160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3383): Terminating (SIGTERM) 09:54:39.143280 --- ParallelTerminationStrategy: PID 3377 died... 09:54:39.163077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3377): Terminated: ok {rc=0} 09:54:39.208859 --- ParallelTerminationStrategy: PID 3380 died... 09:54:39.228659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3380): Terminated: ok {rc=0} 09:54:39.274290 --- ParallelTerminationStrategy: PID 3383 died... 09:54:39.293572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3383): Terminated: ok {rc=0} 09:54:39.379241 bus /sierra_3: Setting Powered False 09:54:40.476439 bus /sierra_3: Setting Powered False 09:54:41.591917 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:54:42.856198 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:42.861551 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:54:42.921461 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:54:42.947812 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:54:42.998498 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:54:43.058193 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:54:43.084649 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:54:43.637556 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:54:43.642928 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:54:43.654382 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:54:43.697276 tst handover.py: using LAC 33183 09:54:43.814771 tst handover.py: using RAC 33 09:54:43.933984 tst handover.py: using CellId 33183 09:54:44.051549 tst handover.py: using BVCI 33184 09:54:44.168437 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:54:44.218616 tst handover.py: using LAC 33184 09:54:44.340398 tst handover.py: using RAC 34 09:54:44.465450 tst handover.py: using CellId 33184 09:54:44.589349 tst handover.py: using BVCI 33185 09:54:44.705528 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:54:44.717583 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:54:44.729192 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:54:44.740766 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:54:44.752245 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:54:44.763591 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:54:44.879533 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:54:44.995585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:45.434841 run create_hlr_db(pid=3389): Launched 09:54:45.550233 bus /sierra_2: Setting Powered False 09:54:46.610178 run create_hlr_db(pid=3389): Terminated: ok {rc=0} 09:54:47.020927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3391): Launched 09:54:47.327204 run osmo-hlr_10.42.42.2(pid=3392): Launched 09:54:47.444550 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:47.953465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3394): Launched 09:54:48.253773 run osmo-stp_10.42.42.5(pid=3395): Launched 09:54:48.368588 run osmo-msc_10.42.42.6: Starting osmo-msc 09:54:48.887574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3397): Launched 09:54:49.186973 run osmo-msc_10.42.42.6(pid=3398): Launched 09:54:49.355825 run osmo-stp_10.42.42.5(pid=3395): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3395)] 09:54:49.483390 run osmo-stp_10.42.42.5(pid=3395): stdout: | (launched: 2022-12-13_09:54:48.198634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:49.610491 run osmo-stp_10.42.42.5(pid=3395): stderr: | 20221213095448370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095448370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095448370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095448370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095448371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095448371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095448371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:49.735078 run osmo-stp_10.42.42.5(pid=3395): stdout: | (launched: 2022-12-13_09:54:48.198634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:49.854967 run osmo-stp_10.42.42.5(pid=3395): stderr: | 20221213095448370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095448370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095448370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095448370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095448371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095448371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095448371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:49.997925 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3395): Process ended prematurely: osmo-stp_10.42.42.5(pid=3395) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3395)] [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 09:54:50.006143 tst handover.py:18: Test FAILED (6.4 sec) 09:54:50.031961 run osmo-hlr_10.42.42.2(pid=3392): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3392)] 09:54:50.080673 run osmo-hlr_10.42.42.2(pid=3392): stdout: | (launched: 2022-12-13_09:54:47.272260) 09:54:50.129886 run osmo-hlr_10.42.42.2(pid=3392): stderr: | 20221213095447450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095447450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095447450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095447450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095447450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095447450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095447462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095447471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095447471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095447471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:50.198682 run osmo-msc_10.42.42.6(pid=3398): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3398)] 09:54:50.245545 run osmo-msc_10.42.42.6(pid=3398): stdout: | (launched: 2022-12-13_09:54:49.131935) 09:54:50.294153 run osmo-msc_10.42.42.6(pid=3398): stderr: | 20221213095449402 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095449402 DLGLOBAL DEBUG validating counter group 0x7f7caf781c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095449402 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095449402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095449402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095449402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095449404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095449404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095449405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095449405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:54:50.343463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3391): Terminating (SIGTERM) 09:54:50.382754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3394): Terminating (SIGTERM) 09:54:50.422126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3397): Terminating (SIGTERM) 09:54:50.462058 --- ParallelTerminationStrategy: PID 3391 died... 09:54:50.481340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3391): Terminated: ok {rc=0} 09:54:50.525108 --- ParallelTerminationStrategy: PID 3394 died... 09:54:50.543841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3394): Terminated: ok {rc=0} 09:54:50.587963 --- ParallelTerminationStrategy: PID 3397 died... 09:54:50.606659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3397): Terminated: ok {rc=0} 09:54:50.692182 bus /sierra_3: Setting Powered False 09:54:51.790870 bus /sierra_3: Setting Powered False 09:54:52.905597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 09:54:54.171189 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:54.176086 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:54:54.223295 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:54:54.249464 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:54:54.302060 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:54:54.350291 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:54:54.377633 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:54:54.924610 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 09:54:54.930709 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:54.942212 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:54:54.985452 tst handover.py: using LAC 33185 09:54:55.112334 tst handover.py: using RAC 35 09:54:55.238105 tst handover.py: using CellId 33185 09:54:55.362893 tst handover.py: using BVCI 33186 09:54:55.481234 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:54:55.517197 tst handover.py: using LAC 33186 09:54:55.642673 tst handover.py: using RAC 36 09:54:55.769506 tst handover.py: using CellId 33186 09:54:55.890392 tst handover.py: using BVCI 33187 09:54:55.999633 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.010927 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.021982 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.033079 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.044703 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.056352 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:54:56.176168 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:54:56.291870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:56.730785 run create_hlr_db(pid=3404): Launched 09:54:56.844535 bus /sierra_2: Setting Powered False 09:54:57.904696 run create_hlr_db(pid=3404): Terminated: ok {rc=0} 09:54:58.295377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3406): Launched 09:54:58.593670 run osmo-hlr_10.42.42.2(pid=3407): Launched 09:54:58.708581 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:59.212379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3409): Launched 09:54:59.512270 run osmo-stp_10.42.42.5(pid=3410): Launched 09:54:59.627103 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:00.142450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3412): Launched 09:55:00.440522 run osmo-msc_10.42.42.6(pid=3413): Launched 09:55:00.608473 run osmo-stp_10.42.42.5(pid=3410): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3410)] 09:55:00.736700 run osmo-stp_10.42.42.5(pid=3410): stdout: | (launched: 2022-12-13_09:54:59.457717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:00.878722 run osmo-stp_10.42.42.5(pid=3410): stderr: | 20221213095459628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095459628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095459628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095459629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095459629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095459629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095459629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:01.016869 run osmo-stp_10.42.42.5(pid=3410): stdout: | (launched: 2022-12-13_09:54:59.457717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:01.139646 run osmo-stp_10.42.42.5(pid=3410): stderr: | 20221213095459628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095459628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095459628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095459629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095459629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095459629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095459629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:01.289119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3410): Process ended prematurely: osmo-stp_10.42.42.5(pid=3410) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3410)] [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 09:55:01.299812 tst handover.py:18: Test FAILED (6.4 sec) 09:55:01.330112 run osmo-hlr_10.42.42.2(pid=3407): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3407)] 09:55:01.380470 run osmo-hlr_10.42.42.2(pid=3407): stdout: | (launched: 2022-12-13_09:54:58.538806) 09:55:01.431348 run osmo-hlr_10.42.42.2(pid=3407): stderr: | 20221213095458713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095458713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095458713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095458713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095458713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095458713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095458725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095458733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095458733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095458733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:01.502687 run osmo-msc_10.42.42.6(pid=3413): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3413)] 09:55:01.551052 run osmo-msc_10.42.42.6(pid=3413): stdout: | (launched: 2022-12-13_09:55:00.386011) 09:55:01.603830 run osmo-msc_10.42.42.6(pid=3413): stderr: | 20221213095500655 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095500655 DLGLOBAL DEBUG validating counter group 0x7f78a29f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095500655 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095500655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095500655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095500655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095500657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095500658 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095500658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095500658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:01.655425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3406): Terminating (SIGTERM) 09:55:01.697389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3409): Terminating (SIGTERM) 09:55:01.740515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3412): Terminating (SIGTERM) 09:55:01.782662 --- ParallelTerminationStrategy: PID 3406 died... 09:55:01.803535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3406): Terminated: ok {rc=0} 09:55:01.849714 --- ParallelTerminationStrategy: PID 3409 died... 09:55:01.870218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3409): Terminated: ok {rc=0} 09:55:01.916198 --- ParallelTerminationStrategy: PID 3412 died... 09:55:01.936910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3412): Terminated: ok {rc=0} 09:55:02.025827 bus /sierra_3: Setting Powered False 09:55:03.127452 bus /sierra_3: Setting Powered False 09:55:04.241475 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 09:55:05.490598 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:05.495915 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:55:05.553594 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:55:05.579639 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:55:05.631398 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:55:05.691433 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:55:05.717841 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:55:06.267171 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 09:55:06.272497 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:06.283530 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:55:06.326908 tst handover.py: using LAC 33187 09:55:06.445655 tst handover.py: using RAC 37 09:55:06.562886 tst handover.py: using CellId 33187 09:55:06.684833 tst handover.py: using BVCI 33188 09:55:06.794347 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:55:06.847671 tst handover.py: using LAC 33188 09:55:06.969297 tst handover.py: using RAC 38 09:55:07.091015 tst handover.py: using CellId 33188 09:55:07.208345 tst handover.py: using BVCI 33189 09:55:07.317241 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:07.328418 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:07.339446 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:07.350493 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:07.361936 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:07.373429 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:55:07.492559 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:55:07.607977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:08.045969 run create_hlr_db(pid=3421): Launched 09:55:08.159632 bus /sierra_2: Setting Powered False 09:55:09.222482 run create_hlr_db(pid=3421): Terminated: ok {rc=0} 09:55:09.623955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3423): Launched 09:55:09.923111 run osmo-hlr_10.42.42.2(pid=3424): Launched 09:55:10.037686 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:10.543423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3426): Launched 09:55:10.841425 run osmo-stp_10.42.42.5(pid=3427): Launched 09:55:10.956112 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:11.476089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3429): Launched 09:55:11.774088 run osmo-msc_10.42.42.6(pid=3430): Launched 09:55:11.948460 run osmo-stp_10.42.42.5(pid=3427): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3427)] 09:55:12.076093 run osmo-stp_10.42.42.5(pid=3427): stdout: | (launched: 2022-12-13_09:55:10.786464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:12.203024 run osmo-stp_10.42.42.5(pid=3427): stderr: | 20221213095510957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095510957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095510958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095510958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095510958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095510959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095510959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:12.327949 run osmo-stp_10.42.42.5(pid=3427): stdout: | (launched: 2022-12-13_09:55:10.786464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:12.446919 run osmo-stp_10.42.42.5(pid=3427): stderr: | 20221213095510957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095510957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095510958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095510958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095510958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095510959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095510959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:12.589876 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3427): Process ended prematurely: osmo-stp_10.42.42.5(pid=3427) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3427)] [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 09:55:12.598117 tst handover.py:18: Test FAILED (6.3 sec) 09:55:12.623981 run osmo-hlr_10.42.42.2(pid=3424): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3424)] 09:55:12.672012 run osmo-hlr_10.42.42.2(pid=3424): stdout: | (launched: 2022-12-13_09:55:09.868664) 09:55:12.721129 run osmo-hlr_10.42.42.2(pid=3424): stderr: | 20221213095510043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095510043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095510043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095510043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095510044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095510044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095510056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095510064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095510064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095510064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:12.790214 run osmo-msc_10.42.42.6(pid=3430): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3430)] 09:55:12.837277 run osmo-msc_10.42.42.6(pid=3430): stdout: | (launched: 2022-12-13_09:55:11.719489) 09:55:12.886240 run osmo-msc_10.42.42.6(pid=3430): stderr: | 20221213095511994 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095511994 DLGLOBAL DEBUG validating counter group 0x7f2d25faac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095511994 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095511994 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095511994 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095511995 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095511996 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095511997 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095511997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095511997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:12.935423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3423): Terminating (SIGTERM) 09:55:12.974934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3426): Terminating (SIGTERM) 09:55:13.014280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3429): Terminating (SIGTERM) 09:55:13.054240 --- ParallelTerminationStrategy: PID 3423 died... 09:55:13.073607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3423): Terminated: ok {rc=0} 09:55:13.117362 --- ParallelTerminationStrategy: PID 3426 died... 09:55:13.136017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3426): Terminated: ok {rc=0} 09:55:13.179782 --- ParallelTerminationStrategy: PID 3429 died... 09:55:13.198570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3429): Terminated: ok {rc=0} 09:55:13.281332 bus /sierra_3: Setting Powered False 09:55:14.376418 bus /sierra_3: Setting Powered False 09:55:15.490592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 09:55:16.766349 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:16.773609 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:55:16.833985 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:55:16.861373 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:55:16.915583 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:55:16.975669 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:55:17.003203 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:55:17.548546 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 09:55:17.555108 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:17.567137 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:55:17.613278 tst handover.py: using LAC 33189 09:55:17.732183 tst handover.py: using RAC 39 09:55:17.852083 tst handover.py: using CellId 33189 09:55:17.978434 tst handover.py: using BVCI 33190 09:55:18.096064 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:55:18.143788 tst handover.py: using LAC 33190 09:55:18.271035 tst handover.py: using RAC 40 09:55:18.396009 tst handover.py: using CellId 33190 09:55:18.522749 tst handover.py: using BVCI 33191 09:55:18.639175 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:18.650719 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:18.662028 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:18.673879 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:18.685277 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:18.696413 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:55:18.812020 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:55:18.929542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:19.397708 run create_hlr_db(pid=3435): Launched 09:55:19.528300 bus /sierra_2: Setting Powered False 09:55:20.588225 run create_hlr_db(pid=3435): Terminated: ok {rc=0} 09:55:20.981181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3437): Launched 09:55:21.280895 run osmo-hlr_10.42.42.2(pid=3438): Launched 09:55:21.395758 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:21.889115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3440): Launched 09:55:22.187977 run osmo-stp_10.42.42.5(pid=3441): Launched 09:55:22.302782 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:22.816784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3443): Launched 09:55:23.115044 run osmo-msc_10.42.42.6(pid=3444): Launched 09:55:23.282027 run osmo-stp_10.42.42.5(pid=3441): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3441)] 09:55:23.411170 run osmo-stp_10.42.42.5(pid=3441): stdout: | (launched: 2022-12-13_09:55:22.133488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:23.537842 run osmo-stp_10.42.42.5(pid=3441): stderr: | 20221213095522304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095522304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095522304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095522305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095522305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095522305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095522306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:23.662571 run osmo-stp_10.42.42.5(pid=3441): stdout: | (launched: 2022-12-13_09:55:22.133488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:23.781981 run osmo-stp_10.42.42.5(pid=3441): stderr: | 20221213095522304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095522304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095522304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095522305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095522305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095522305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095522306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:23.925144 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3441): Process ended prematurely: osmo-stp_10.42.42.5(pid=3441) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3441)] [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 09:55:23.933362 tst handover.py:18: Test FAILED (6.4 sec) 09:55:23.959132 run osmo-hlr_10.42.42.2(pid=3438): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3438)] 09:55:24.007343 run osmo-hlr_10.42.42.2(pid=3438): stdout: | (launched: 2022-12-13_09:55:21.226337) 09:55:24.056361 run osmo-hlr_10.42.42.2(pid=3438): stderr: | 20221213095521404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095521404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095521404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095521404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095521404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095521404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095521416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095521425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095521425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095521425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:24.124892 run osmo-msc_10.42.42.6(pid=3444): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3444)] 09:55:24.171651 run osmo-msc_10.42.42.6(pid=3444): stdout: | (launched: 2022-12-13_09:55:23.060525) 09:55:24.220149 run osmo-msc_10.42.42.6(pid=3444): stderr: | 20221213095523331 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095523331 DLGLOBAL DEBUG validating counter group 0x7fb56a4e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095523331 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095523331 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095523331 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095523332 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095523333 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095523334 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095523334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095523334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:24.269338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3437): Terminating (SIGTERM) 09:55:24.308151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3440): Terminating (SIGTERM) 09:55:24.347214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3443): Terminating (SIGTERM) 09:55:24.386492 --- ParallelTerminationStrategy: PID 3437 died... 09:55:24.405631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3437): Terminated: ok {rc=0} 09:55:24.448892 --- ParallelTerminationStrategy: PID 3440 died... 09:55:24.467884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3440): Terminated: ok {rc=0} 09:55:24.511450 --- ParallelTerminationStrategy: PID 3443 died... 09:55:24.530535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3443): Terminated: ok {rc=0} 09:55:24.615527 bus /sierra_3: Setting Powered False 09:55:25.713336 bus /sierra_3: Setting Powered False 09:55:26.827821 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 09:55:28.103096 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:28.109983 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:55:28.161961 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:55:28.189382 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:55:28.240477 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:55:28.292146 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:55:28.319311 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:55:28.873888 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 09:55:28.879525 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:55:28.890889 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:55:28.941407 tst handover.py: using LAC 33191 09:55:29.065901 tst handover.py: using RAC 41 09:55:29.190939 tst handover.py: using CellId 33191 09:55:29.314552 tst handover.py: using BVCI 33192 09:55:29.432050 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:55:29.466704 tst handover.py: using LAC 33192 09:55:29.593616 tst handover.py: using RAC 42 09:55:29.710370 tst handover.py: using CellId 33192 09:55:29.827610 tst handover.py: using BVCI 33193 09:55:29.936702 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:55:29.947803 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:55:29.958647 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:55:29.969269 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:55:29.980317 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:55:29.991445 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:55:30.112881 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:55:30.231792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:30.701815 run create_hlr_db(pid=3449): Launched 09:55:30.831781 bus /sierra_2: Setting Powered False 09:55:31.902313 run create_hlr_db(pid=3449): Terminated: ok {rc=0} 09:55:32.312001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3451): Launched 09:55:32.612711 run osmo-hlr_10.42.42.2(pid=3452): Launched 09:55:32.727114 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:33.234312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3454): Launched 09:55:33.533595 run osmo-stp_10.42.42.5(pid=3455): Launched 09:55:33.650384 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:34.166857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3457): Launched 09:55:34.466778 run osmo-msc_10.42.42.6(pid=3458): Launched 09:55:34.634298 run osmo-stp_10.42.42.5(pid=3455): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3455)] 09:55:34.761242 run osmo-stp_10.42.42.5(pid=3455): stdout: | (launched: 2022-12-13_09:55:33.478688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:34.888008 run osmo-stp_10.42.42.5(pid=3455): stderr: | 20221213095533652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095533652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095533652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095533653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095533653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095533653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095533653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:35.012842 run osmo-stp_10.42.42.5(pid=3455): stdout: | (launched: 2022-12-13_09:55:33.478688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:35.132608 run osmo-stp_10.42.42.5(pid=3455): stderr: | 20221213095533652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095533652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095533652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095533653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095533653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095533653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095533653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:35.275785 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3455): Process ended prematurely: osmo-stp_10.42.42.5(pid=3455) [trial-2387↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3455)] [trial-2387↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 09:55:35.284061 tst handover.py:18: Test FAILED (6.4 sec) 09:55:35.310015 run osmo-hlr_10.42.42.2(pid=3452): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3452)] 09:55:35.359142 run osmo-hlr_10.42.42.2(pid=3452): stdout: | (launched: 2022-12-13_09:55:32.557935) 09:55:35.408778 run osmo-hlr_10.42.42.2(pid=3452): stderr: | 20221213095532736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095532736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095532736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095532736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095532736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095532736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095532748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095532757 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095532757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095532757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:35.477752 run osmo-msc_10.42.42.6(pid=3458): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3458)] 09:55:35.525197 run osmo-msc_10.42.42.6(pid=3458): stdout: | (launched: 2022-12-13_09:55:34.411714) 09:55:35.574534 run osmo-msc_10.42.42.6(pid=3458): stderr: | 20221213095534682 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095534682 DLGLOBAL DEBUG validating counter group 0x7f03e4dd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095534682 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095534682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095534682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095534683 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095534684 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095534685 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095534685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095534685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:35.624253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3451): Terminating (SIGTERM) 09:55:35.663874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3454): Terminating (SIGTERM) 09:55:35.703547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3457): Terminating (SIGTERM) 09:55:35.743603 --- ParallelTerminationStrategy: PID 3451 died... 09:55:35.762500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3451): Terminated: ok {rc=0} 09:55:35.806753 --- ParallelTerminationStrategy: PID 3454 died... 09:55:35.825708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3454): Terminated: ok {rc=0} 09:55:35.869696 --- ParallelTerminationStrategy: PID 3457 died... 09:55:35.888799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3457): Terminated: ok {rc=0} 09:55:35.972477 bus /sierra_3: Setting Powered False 09:55:37.069766 bus /sierra_3: Setting Powered False 09:55:38.187834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 09:55:39.451223 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:39.457113 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:55:39.520865 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:55:39.547246 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:55:39.599839 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:55:39.668543 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:55:39.695824 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:55:40.239527 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 09:55:40.245395 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:40.256708 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:55:40.305160 tst handover.py: using LAC 33193 09:55:40.423294 tst handover.py: using RAC 43 09:55:40.542518 tst handover.py: using CellId 33193 09:55:40.661761 tst handover.py: using BVCI 33194 09:55:40.772098 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:55:40.820279 tst handover.py: using LAC 33194 09:55:40.950208 tst handover.py: using RAC 44 09:55:41.075361 tst handover.py: using CellId 33194 09:55:41.199601 tst handover.py: using BVCI 33195 09:55:41.316741 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:41.328372 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:41.339693 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:41.350891 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:41.362254 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:55:41.373435 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:55:41.489656 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:55:41.609447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:42.081541 run create_hlr_db(pid=3463): Launched 09:55:42.211568 bus /sierra_2: Setting Powered False 09:55:43.274309 run create_hlr_db(pid=3463): Terminated: ok {rc=0} 09:55:43.676091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3465): Launched 09:55:43.976286 run osmo-hlr_10.42.42.2(pid=3466): Launched 09:55:44.091418 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:44.592754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3468): Launched 09:55:44.891788 run osmo-stp_10.42.42.5(pid=3469): Launched 09:55:45.007424 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:45.523821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3471): Launched 09:55:45.823427 run osmo-msc_10.42.42.6(pid=3472): Launched 09:55:46.049058 run osmo-stp_10.42.42.5(pid=3469): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3469)] 09:55:46.308552 run osmo-stp_10.42.42.5(pid=3469): stdout: | (launched: 2022-12-13_09:55:44.836935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:46.639334 run osmo-stp_10.42.42.5(pid=3469): stderr: | 20221213095545008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095545008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095545009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095545009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095545010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095545010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095545010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:46.772778 run osmo-stp_10.42.42.5(pid=3469): stdout: | (launched: 2022-12-13_09:55:44.836935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:46.896007 run osmo-stp_10.42.42.5(pid=3469): stderr: | 20221213095545008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095545008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095545009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095545009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095545010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095545010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095545010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:47.042799 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3469): Process ended prematurely: osmo-stp_10.42.42.5(pid=3469) [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3469)] [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 09:55:47.051908 tst handover.py:18: Test FAILED (6.8 sec) 09:55:47.078921 run osmo-hlr_10.42.42.2(pid=3466): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3466)] 09:55:47.129433 run osmo-hlr_10.42.42.2(pid=3466): stdout: | (launched: 2022-12-13_09:55:43.921277) 09:55:47.180444 run osmo-hlr_10.42.42.2(pid=3466): stderr: | 20221213095544098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095544098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095544098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095544098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095544098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095544098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095544110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095544121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095544121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095544121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:47.252150 run osmo-msc_10.42.42.6(pid=3472): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3472)] 09:55:47.300243 run osmo-msc_10.42.42.6(pid=3472): stdout: | (launched: 2022-12-13_09:55:45.768577) 09:55:47.351398 run osmo-msc_10.42.42.6(pid=3472): stderr: | 20221213095546288 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095546297 DLGLOBAL DEBUG validating counter group 0x7fe5da84bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095546297 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095546297 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095546297 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095546298 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095546299 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095546300 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095546300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095546300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:47.400504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3465): Terminating (SIGTERM) 09:55:47.439790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3468): Terminating (SIGTERM) 09:55:47.479691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3471): Terminating (SIGTERM) 09:55:47.519838 --- ParallelTerminationStrategy: PID 3465 died... 09:55:47.539514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3465): Terminated: ok {rc=0} 09:55:47.583729 --- ParallelTerminationStrategy: PID 3468 died... 09:55:47.602380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3468): Terminated: ok {rc=0} 09:55:47.646145 --- ParallelTerminationStrategy: PID 3471 died... 09:55:47.664833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3471): Terminated: ok {rc=0} 09:55:47.750086 bus /sierra_3: Setting Powered False 09:55:48.847527 bus /sierra_3: Setting Powered False 09:55:49.960051 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 09:55:51.236438 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:51.242205 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:55:51.306014 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:55:51.333286 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:55:51.385064 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:55:51.449679 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:55:51.477469 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:55:52.028566 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 09:55:52.034767 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:52.046326 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:55:52.094236 tst handover.py: using LAC 33195 09:55:52.212511 tst handover.py: using RAC 45 09:55:52.330325 tst handover.py: using CellId 33195 09:55:52.451410 tst handover.py: using BVCI 33196 09:55:52.568173 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:55:52.617111 tst handover.py: using LAC 33196 09:55:52.742158 tst handover.py: using RAC 46 09:55:52.866820 tst handover.py: using CellId 33196 09:55:52.993522 tst handover.py: using BVCI 33197 09:55:53.105371 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:53.116379 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:53.127378 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:53.138651 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:53.150110 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:55:53.161594 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:55:53.277398 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:55:53.396431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:53.864409 run create_hlr_db(pid=3477): Launched 09:55:53.994114 bus /sierra_2: Setting Powered False 09:55:55.057036 run create_hlr_db(pid=3477): Terminated: ok {rc=0} 09:55:55.471503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3479): Launched 09:55:55.791070 run osmo-hlr_10.42.42.2(pid=3480): Launched 09:55:55.913264 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:56.434127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3482): Launched 09:55:56.752801 run osmo-stp_10.42.42.5(pid=3483): Launched 09:55:56.875309 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:57.429042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3485): Launched 09:55:57.748827 run osmo-msc_10.42.42.6(pid=3486): Launched 09:55:57.927163 run osmo-stp_10.42.42.5(pid=3483): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3483)] 09:55:58.062527 run osmo-stp_10.42.42.5(pid=3483): stdout: | (launched: 2022-12-13_09:55:56.694856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:58.197501 run osmo-stp_10.42.42.5(pid=3483): stderr: | 20221213095556888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095556888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095556889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095556889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095556890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095556890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095556890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:58.331604 run osmo-stp_10.42.42.5(pid=3483): stdout: | (launched: 2022-12-13_09:55:56.694856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:58.458818 run osmo-stp_10.42.42.5(pid=3483): stderr: | 20221213095556888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095556888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095556889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095556889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095556890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095556890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095556890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:58.611292 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3483): Process ended prematurely: osmo-stp_10.42.42.5(pid=3483) [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3483)] [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 09:55:58.619970 tst handover.py:18: Test FAILED (6.6 sec) 09:55:58.647483 run osmo-hlr_10.42.42.2(pid=3480): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3480)] 09:55:58.697253 run osmo-hlr_10.42.42.2(pid=3480): stdout: | (launched: 2022-12-13_09:55:55.733356) 09:55:58.748278 run osmo-hlr_10.42.42.2(pid=3480): stderr: | 20221213095555929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095555929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095555929 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095555929 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095555930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095555930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095555941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095555949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095555949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095555949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:58.819859 run osmo-msc_10.42.42.6(pid=3486): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3486)] 09:55:58.869548 run osmo-msc_10.42.42.6(pid=3486): stdout: | (launched: 2022-12-13_09:55:57.690355) 09:55:58.920716 run osmo-msc_10.42.42.6(pid=3486): stderr: | 20221213095558011 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095558011 DLGLOBAL DEBUG validating counter group 0x7fa73de25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095558011 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095558011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095558011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095558012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095558013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095558014 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095558014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095558014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:58.972337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3479): Terminating (SIGTERM) 09:55:59.013715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3482): Terminating (SIGTERM) 09:55:59.054935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3485): Terminating (SIGTERM) 09:55:59.096555 --- ParallelTerminationStrategy: PID 3479 died... 09:55:59.116458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3479): Terminated: ok {rc=0} 09:55:59.162674 --- ParallelTerminationStrategy: PID 3482 died... 09:55:59.182108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3482): Terminated: ok {rc=0} 09:55:59.227711 --- ParallelTerminationStrategy: PID 3485 died... 09:55:59.247153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3485): Terminated: ok {rc=0} 09:55:59.333935 bus /sierra_3: Setting Powered False 09:56:00.428589 bus /sierra_3: Setting Powered False 09:56:01.538935 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 09:56:02.804938 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:02.810500 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:56:02.861810 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:56:02.888167 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:56:02.939060 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:56:02.989286 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:56:03.015648 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:56:03.572260 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 09:56:03.577841 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:56:03.588850 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:56:03.623569 tst handover.py: using LAC 33197 09:56:03.742124 tst handover.py: using RAC 47 09:56:03.862132 tst handover.py: using CellId 33197 09:56:03.979368 tst handover.py: using BVCI 33198 09:56:04.089249 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:56:04.136769 tst handover.py: using LAC 33198 09:56:04.262929 tst handover.py: using RAC 48 09:56:04.389088 tst handover.py: using CellId 33198 09:56:04.515473 tst handover.py: using BVCI 33199 09:56:04.633556 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:56:04.645111 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:56:04.656023 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:56:04.667018 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:56:04.678124 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:56:04.689156 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:56:04.804009 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:56:04.923382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:05.392079 run create_hlr_db(pid=3491): Launched 09:56:05.522745 bus /sierra_2: Setting Powered False 09:56:06.586007 run create_hlr_db(pid=3491): Terminated: ok {rc=0} 09:56:06.987563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3493): Launched 09:56:07.287545 run osmo-hlr_10.42.42.2(pid=3494): Launched 09:56:07.403167 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:07.909596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3496): Launched 09:56:08.209603 run osmo-stp_10.42.42.5(pid=3497): Launched 09:56:08.324154 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:08.840809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3499): Launched 09:56:09.140760 run osmo-msc_10.42.42.6(pid=3500): Launched 09:56:09.309214 run osmo-stp_10.42.42.5(pid=3497): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3497)] 09:56:09.439336 run osmo-stp_10.42.42.5(pid=3497): stdout: | (launched: 2022-12-13_09:56:08.154774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:09.567064 run osmo-stp_10.42.42.5(pid=3497): stderr: | 20221213095608323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095608324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095608324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095608324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095608326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095608327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095608327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:09.692481 run osmo-stp_10.42.42.5(pid=3497): stdout: | (launched: 2022-12-13_09:56:08.154774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:09.812371 run osmo-stp_10.42.42.5(pid=3497): stderr: | 20221213095608323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095608324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095608324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095608324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095608326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095608327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095608327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:09.956017 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3497): Process ended prematurely: osmo-stp_10.42.42.5(pid=3497) [trial-2387↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3497)] [trial-2387↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 09:56:09.964388 tst handover.py:18: Test FAILED (6.4 sec) 09:56:09.990273 run osmo-hlr_10.42.42.2(pid=3494): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3494)] 09:56:10.038777 run osmo-hlr_10.42.42.2(pid=3494): stdout: | (launched: 2022-12-13_09:56:07.232836) 09:56:10.087986 run osmo-hlr_10.42.42.2(pid=3494): stderr: | 20221213095607407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095607407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095607407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095607407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095607407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095607407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095607419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095607427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095607427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095607427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:10.157386 run osmo-msc_10.42.42.6(pid=3500): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3500)] 09:56:10.204513 run osmo-msc_10.42.42.6(pid=3500): stdout: | (launched: 2022-12-13_09:56:09.086056) 09:56:10.253792 run osmo-msc_10.42.42.6(pid=3500): stderr: | 20221213095609355 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095609356 DLGLOBAL DEBUG validating counter group 0x7fc9215bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095609356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095609356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095609356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095609356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095609358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095609358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095609358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095609359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:10.303311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3493): Terminating (SIGTERM) 09:56:10.342780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3496): Terminating (SIGTERM) 09:56:10.382480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3499): Terminating (SIGTERM) 09:56:10.422411 --- ParallelTerminationStrategy: PID 3493 died... 09:56:10.441894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3493): Terminated: ok {rc=0} 09:56:10.485840 --- ParallelTerminationStrategy: PID 3496 died... 09:56:10.504543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3496): Terminated: ok {rc=0} 09:56:10.548335 --- ParallelTerminationStrategy: PID 3499 died... 09:56:10.567012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3499): Terminated: ok {rc=0} 09:56:10.652163 bus /sierra_3: Setting Powered False 09:56:11.750403 bus /sierra_3: Setting Powered False 09:56:12.865410 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 09:56:14.120392 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:14.125947 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:56:14.176271 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:56:14.204082 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:56:14.258855 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:56:14.308875 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:56:14.335003 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:56:14.885871 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 09:56:14.891486 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:14.902914 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:56:14.937346 tst handover.py: using LAC 33199 09:56:15.063975 tst handover.py: using RAC 49 09:56:15.187687 tst handover.py: using CellId 33199 09:56:15.315209 tst handover.py: using BVCI 33200 09:56:15.433261 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:56:15.481215 tst handover.py: using LAC 33200 09:56:15.598064 tst handover.py: using RAC 50 09:56:15.713395 tst handover.py: using CellId 33200 09:56:15.828505 tst handover.py: using BVCI 33201 09:56:15.953400 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:15.964684 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:15.975974 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:15.987136 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:15.998889 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:16.010239 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:56:16.143953 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:56:16.262740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:16.766400 run create_hlr_db(pid=3509): Launched 09:56:16.934129 bus /sierra_2: Setting Powered False 09:56:17.997183 run create_hlr_db(pid=3509): Terminated: ok {rc=0} 09:56:18.398570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3511): Launched 09:56:18.697308 run osmo-hlr_10.42.42.2(pid=3512): Launched 09:56:18.812131 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:19.301992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3514): Launched 09:56:19.599899 run osmo-stp_10.42.42.5(pid=3515): Launched 09:56:19.717579 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:20.233648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3517): Launched 09:56:20.532563 run osmo-msc_10.42.42.6(pid=3518): Launched 09:56:20.700229 run osmo-stp_10.42.42.5(pid=3515): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3515)] 09:56:20.829239 run osmo-stp_10.42.42.5(pid=3515): stdout: | (launched: 2022-12-13_09:56:19.545057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:20.956644 run osmo-stp_10.42.42.5(pid=3515): stderr: | 20221213095619715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095619715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095619715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095619716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095619716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095619716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095619716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:21.081989 run osmo-stp_10.42.42.5(pid=3515): stdout: | (launched: 2022-12-13_09:56:19.545057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:21.201509 run osmo-stp_10.42.42.5(pid=3515): stderr: | 20221213095619715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095619715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095619715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095619716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095619716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095619716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095619716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:21.344625 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3515): Process ended prematurely: osmo-stp_10.42.42.5(pid=3515) [trial-2387↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3515)] [trial-2387↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 09:56:21.352862 tst handover.py:18: Test FAILED (6.5 sec) 09:56:21.378704 run osmo-hlr_10.42.42.2(pid=3512): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3512)] 09:56:21.426997 run osmo-hlr_10.42.42.2(pid=3512): stdout: | (launched: 2022-12-13_09:56:18.642737) 09:56:21.475886 run osmo-hlr_10.42.42.2(pid=3512): stderr: | 20221213095618816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095618816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095618816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095618816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095618816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095618816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095618828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095618836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095618837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095618837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:21.544577 run osmo-msc_10.42.42.6(pid=3518): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3518)] 09:56:21.591432 run osmo-msc_10.42.42.6(pid=3518): stdout: | (launched: 2022-12-13_09:56:20.477879) 09:56:21.640942 run osmo-msc_10.42.42.6(pid=3518): stderr: | 20221213095620750 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095620750 DLGLOBAL DEBUG validating counter group 0x7f9b90cc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095620750 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095620750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095620750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095620751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095620752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095620753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095620753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095620753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:21.690228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3511): Terminating (SIGTERM) 09:56:21.729379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3514): Terminating (SIGTERM) 09:56:21.768866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3517): Terminating (SIGTERM) 09:56:21.809214 --- ParallelTerminationStrategy: PID 3511 died... 09:56:21.828549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3511): Terminated: ok {rc=0} 09:56:21.872606 --- ParallelTerminationStrategy: PID 3514 died... 09:56:21.891593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3514): Terminated: ok {rc=0} 09:56:21.935754 --- ParallelTerminationStrategy: PID 3517 died... 09:56:21.954517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3517): Terminated: ok {rc=0} 09:56:22.039852 bus /sierra_3: Setting Powered False 09:56:23.138131 bus /sierra_3: Setting Powered False 09:56:24.252126 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2387 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 09:56:25.506050 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:25.511503 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:56:25.573406 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:56:25.599724 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:56:25.651309 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:56:25.712900 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:56:25.739045 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:56:26.288746 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2387 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 09:56:26.294096 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:26.304920 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:56:26.351977 tst handover.py: using LAC 33201 09:56:26.471028 tst handover.py: using RAC 51 09:56:26.590277 tst handover.py: using CellId 33201 09:56:26.709441 tst handover.py: using BVCI 33202 09:56:26.819340 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:56:26.866498 tst handover.py: using LAC 33202 09:56:26.985733 tst handover.py: using RAC 52 09:56:27.103507 tst handover.py: using CellId 33202 09:56:27.225381 tst handover.py: using BVCI 33203 09:56:27.336098 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:27.347106 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:27.357996 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:27.368597 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:27.379731 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:56:27.390838 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:56:27.509165 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:56:27.628573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:28.066987 run create_hlr_db(pid=3523): Launched 09:56:28.181125 bus /sierra_2: Setting Powered False 09:56:29.241036 run create_hlr_db(pid=3523): Terminated: ok {rc=0} 09:56:29.649299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Launched 09:56:29.969262 run osmo-hlr_10.42.42.2(pid=3526): Launched 09:56:30.092377 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:30.617533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Launched 09:56:30.956440 run osmo-stp_10.42.42.5(pid=3529): Launched 09:56:31.148643 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:31.813788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3531): Launched 09:56:32.153539 run osmo-msc_10.42.42.6(pid=3532): Launched 09:56:32.387089 run osmo-stp_10.42.42.5(pid=3529): ERR: Terminated: ERROR {rc=1} [trial-2387↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] 09:56:32.518228 run osmo-stp_10.42.42.5(pid=3529): stdout: | (launched: 2022-12-13_09:56:30.887989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:32.645932 run osmo-stp_10.42.42.5(pid=3529): stderr: | 20221213095631228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095631228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095631228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095631229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095631229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095631229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095631229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:32.772281 run osmo-stp_10.42.42.5(pid=3529): stdout: | (launched: 2022-12-13_09:56:30.887989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:32.891750 run osmo-stp_10.42.42.5(pid=3529): stderr: | 20221213095631228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213095631228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213095631228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213095631229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213095631229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213095631229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213095631229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:33.035131 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3529): Process ended prematurely: osmo-stp_10.42.42.5(pid=3529) [trial-2387↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] [trial-2387↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 09:56:33.043502 tst handover.py:18: Test FAILED (6.7 sec) 09:56:33.069551 run osmo-hlr_10.42.42.2(pid=3526): ERR: Terminated: ERROR {rc=237} [trial-2387↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3526)] 09:56:33.117900 run osmo-hlr_10.42.42.2(pid=3526): stdout: | (launched: 2022-12-13_09:56:29.910986) 09:56:33.166960 run osmo-hlr_10.42.42.2(pid=3526): stderr: | 20221213095630110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213095630110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213095630110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213095630110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213095630110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213095630110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213095630122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213095630130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213095630131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213095630131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:33.236080 run osmo-msc_10.42.42.6(pid=3532): ERR: Terminated: ERROR {rc=2} [trial-2387↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3532)] 09:56:33.283438 run osmo-msc_10.42.42.6(pid=3532): stdout: | (launched: 2022-12-13_09:56:32.090083) 09:56:33.332586 run osmo-msc_10.42.42.6(pid=3532): stderr: | 20221213095632442 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213095632442 DLGLOBAL DEBUG validating counter group 0x7fc325b78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213095632442 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213095632443 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213095632443 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213095632443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213095632445 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213095632445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213095632445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213095632445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:33.382652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Terminating (SIGTERM) 09:56:33.422414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Terminating (SIGTERM) 09:56:33.462231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3531): Terminating (SIGTERM) 09:56:33.502526 --- ParallelTerminationStrategy: PID 3525 died... 09:56:33.522133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Terminated: ok {rc=0} 09:56:33.566519 --- ParallelTerminationStrategy: PID 3528 died... 09:56:33.585529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Terminated: ok {rc=0} 09:56:33.629790 --- ParallelTerminationStrategy: PID 3531 died... 09:56:33.648788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3531): Terminated: ok {rc=0} 09:56:33.732720 bus /sierra_3: Setting Powered False 09:56:34.826595 bus /sierra_3: Setting Powered False 09:56:35.939051 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2387 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 09:56:37.213566 tst trial-2387: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/trial-2387.xml -------------------------------------------------------------------------------------------- trial-2387 FAIL -------------------------------------------------------------------------------------------- 09:56:39.150295 tst trial-2387: trial-2387: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.2 sec) Error: osmo-nitb_10.42.42.2(pid=26355): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26355) [trial-2387↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26355)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=26366): Process ended prematurely: osmo-stp_10.42.42.5(pid=26366) [trial-2387↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26366)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26376): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26376) [trial-2387↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26376)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26386): Process ended prematurely: osmo-stp_10.42.42.5(pid=26386) [trial-2387↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26386)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26400): Process ended prematurely: osmo-stp_10.42.42.5(pid=26400) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26400)] FAIL: mo_mt_call_osmux.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26412): Process ended prematurely: osmo-stp_10.42.42.5(pid=26412) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26412)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26426): Process ended prematurely: osmo-stp_10.42.42.5(pid=26426) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26426)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26437): Process ended prematurely: osmo-stp_10.42.42.5(pid=26437) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26437)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26451): Process ended prematurely: osmo-stp_10.42.42.5(pid=26451) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26451)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26463): Process ended prematurely: osmo-stp_10.42.42.5(pid=26463) [trial-2387↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26463)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26477): Process ended prematurely: osmo-stp_10.42.42.5(pid=26477) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26477)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26488): Process ended prematurely: osmo-stp_10.42.42.5(pid=26488) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26488)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26502): Process ended prematurely: osmo-stp_10.42.42.5(pid=26502) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26502)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26513): Process ended prematurely: osmo-stp_10.42.42.5(pid=26513) [trial-2387↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26513)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26529): Process ended prematurely: osmo-stp_10.42.42.5(pid=26529) [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26529)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26540): Process ended prematurely: osmo-stp_10.42.42.5(pid=26540) [trial-2387↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26540)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26554): Process ended prematurely: osmo-stp_10.42.42.5(pid=26554) [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26554)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26565): Process ended prematurely: osmo-stp_10.42.42.5(pid=26565) [trial-2387↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26579): Process ended prematurely: osmo-stp_10.42.42.5(pid=26579) [trial-2387↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26579)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26590): Process ended prematurely: osmo-stp_10.42.42.5(pid=26590) [trial-2387↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26590)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26879): Process ended prematurely: osmo-stp_10.42.42.5(pid=26879) [trial-2387↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26879)] FAIL: iperf3.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=26891): Process ended prematurely: osmo-stp_10.42.42.5(pid=26891) [trial-2387↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26891)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=26910): Process ended prematurely: osmo-stp_10.42.42.5(pid=26910) [trial-2387↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26910)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26920): Process ended prematurely: osmo-stp_10.42.42.5(pid=26920) [trial-2387↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26920)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26930): Process ended prematurely: osmo-stp_10.42.42.5(pid=26930) [trial-2387↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26930)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26949): Process ended prematurely: osmo-stp_10.42.42.5(pid=26949) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26949)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26964): Process ended prematurely: osmo-stp_10.42.42.5(pid=26964) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26964)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=26982): Process ended prematurely: osmo-stp_10.42.42.5(pid=26982) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26982)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26992): Process ended prematurely: osmo-stp_10.42.42.5(pid=26992) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26992)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27002): Process ended prematurely: osmo-stp_10.42.42.5(pid=27002) [trial-2387↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27002)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=27021): Process ended prematurely: osmo-stp_10.42.42.5(pid=27021) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27021)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27033): Process ended prematurely: osmo-stp_10.42.42.5(pid=27033) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27033)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=27051): Process ended prematurely: osmo-stp_10.42.42.5(pid=27051) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27051)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27061): Process ended prematurely: osmo-stp_10.42.42.5(pid=27061) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27061)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27071): Process ended prematurely: osmo-stp_10.42.42.5(pid=27071) [trial-2387↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27071)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=27091): Process ended prematurely: osmo-stp_10.42.42.5(pid=27091) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27091)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27108): Process ended prematurely: osmo-stp_10.42.42.5(pid=27108) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27108)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27126): Process ended prematurely: osmo-stp_10.42.42.5(pid=27126) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27126)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27136): Process ended prematurely: osmo-stp_10.42.42.5(pid=27136) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27136)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27146): Process ended prematurely: osmo-stp_10.42.42.5(pid=27146) [trial-2387↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27146)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27159): Process ended prematurely: osmo-stp_10.42.42.5(pid=27159) [trial-2387↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27159)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27172): Process ended prematurely: osmo-stp_10.42.42.5(pid=27172) [trial-2387↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27172)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27181): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27181) [trial-2387↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27181)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27191): Process ended prematurely: osmo-stp_10.42.42.5(pid=27191) [trial-2387↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27200) [trial-2387↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27200)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=27210): Process ended prematurely: osmo-stp_10.42.42.5(pid=27210) [trial-2387↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27210)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27225): Process ended prematurely: osmo-stp_10.42.42.5(pid=27225) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27225)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27236): Process ended prematurely: osmo-stp_10.42.42.5(pid=27236) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27236)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27250): Process ended prematurely: osmo-stp_10.42.42.5(pid=27250) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27250)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27261): Process ended prematurely: osmo-stp_10.42.42.5(pid=27261) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27261)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27275): Process ended prematurely: osmo-stp_10.42.42.5(pid=27275) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27275)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27286): Process ended prematurely: osmo-stp_10.42.42.5(pid=27286) [trial-2387↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27286)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27300): Process ended prematurely: osmo-stp_10.42.42.5(pid=27300) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27300)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27314): Process ended prematurely: osmo-stp_10.42.42.5(pid=27314) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27314)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27328): Process ended prematurely: osmo-stp_10.42.42.5(pid=27328) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27328)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27339): Process ended prematurely: osmo-stp_10.42.42.5(pid=27339) [trial-2387↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27339)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27354): Process ended prematurely: osmo-stp_10.42.42.5(pid=27354) [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27354)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27366): Process ended prematurely: osmo-stp_10.42.42.5(pid=27366) [trial-2387↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27366)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27380): Process ended prematurely: osmo-stp_10.42.42.5(pid=27380) [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27380)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27391): Process ended prematurely: osmo-stp_10.42.42.5(pid=27391) [trial-2387↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27391)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27406): Process ended prematurely: osmo-stp_10.42.42.5(pid=27406) [trial-2387↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27406)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27417): Process ended prematurely: osmo-stp_10.42.42.5(pid=27417) [trial-2387↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27417)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27435): Process ended prematurely: osmo-stp_10.42.42.5(pid=27435) [trial-2387↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27435)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27447): Process ended prematurely: osmo-stp_10.42.42.5(pid=27447) [trial-2387↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27447)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27466): Process ended prematurely: osmo-stp_10.42.42.5(pid=27466) [trial-2387↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27466)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27476): Process ended prematurely: osmo-stp_10.42.42.5(pid=27476) [trial-2387↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27476)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27486): Process ended prematurely: osmo-stp_10.42.42.5(pid=27486) [trial-2387↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27486)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=27504): Process ended prematurely: osmo-stp_10.42.42.5(pid=27504) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27504)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27516): Process ended prematurely: osmo-stp_10.42.42.5(pid=27516) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27516)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=27534): Process ended prematurely: osmo-stp_10.42.42.5(pid=27534) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27534)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27546): Process ended prematurely: osmo-stp_10.42.42.5(pid=27546) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27546)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27556): Process ended prematurely: osmo-stp_10.42.42.5(pid=27556) [trial-2387↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27556)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=27573): Process ended prematurely: osmo-stp_10.42.42.5(pid=27573) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27573)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27585): Process ended prematurely: osmo-stp_10.42.42.5(pid=27585) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27585)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=27603): Process ended prematurely: osmo-stp_10.42.42.5(pid=27603) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27603)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27613): Process ended prematurely: osmo-stp_10.42.42.5(pid=27613) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27613)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27623): Process ended prematurely: osmo-stp_10.42.42.5(pid=27623) [trial-2387↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27623)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=27640): Process ended prematurely: osmo-stp_10.42.42.5(pid=27640) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27640)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27652): Process ended prematurely: osmo-stp_10.42.42.5(pid=27652) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27652)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27680): Process ended prematurely: osmo-stp_10.42.42.5(pid=27680) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27680)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28041): Process ended prematurely: osmo-stp_10.42.42.5(pid=28041) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28041)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=28228): Process ended prematurely: osmo-stp_10.42.42.5(pid=28228) [trial-2387↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28228)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28242): Process ended prematurely: osmo-stp_10.42.42.5(pid=28242) [trial-2387↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28242)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2387↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28268): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28268) [trial-2387↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28268)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28279): Process ended prematurely: osmo-stp_10.42.42.5(pid=28279) [trial-2387↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28279)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28288): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28288) [trial-2387↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28288)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=28298): Process ended prematurely: osmo-stp_10.42.42.5(pid=28298) [trial-2387↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28298)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28312): Process ended prematurely: osmo-stp_10.42.42.5(pid=28312) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28324): Process ended prematurely: osmo-stp_10.42.42.5(pid=28324) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28324)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28338): Process ended prematurely: osmo-stp_10.42.42.5(pid=28338) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28338)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28349): Process ended prematurely: osmo-stp_10.42.42.5(pid=28349) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28349)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28364): Process ended prematurely: osmo-stp_10.42.42.5(pid=28364) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28364)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28375): Process ended prematurely: osmo-stp_10.42.42.5(pid=28375) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28375)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28389): Process ended prematurely: osmo-stp_10.42.42.5(pid=28389) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28389)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28400): Process ended prematurely: osmo-stp_10.42.42.5(pid=28400) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28400)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28414): Process ended prematurely: osmo-stp_10.42.42.5(pid=28414) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28414)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28425): Process ended prematurely: osmo-stp_10.42.42.5(pid=28425) [trial-2387↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28439): Process ended prematurely: osmo-stp_10.42.42.5(pid=28439) [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28439)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28450): Process ended prematurely: osmo-stp_10.42.42.5(pid=28450) [trial-2387↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28450)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28465): Process ended prematurely: osmo-stp_10.42.42.5(pid=28465) [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28465)] FAIL: mo_mt_call_osmux.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=28748): Process ended prematurely: osmo-stp_10.42.42.5(pid=28748) [trial-2387↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28748)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28762): Process ended prematurely: osmo-stp_10.42.42.5(pid=28762) [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28762)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2387↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28788): Process ended prematurely: osmo-stp_10.42.42.5(pid=28788) [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28799): Process ended prematurely: osmo-stp_10.42.42.5(pid=28799) [trial-2387↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28799)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28814): Process ended prematurely: osmo-stp_10.42.42.5(pid=28814) [trial-2387↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28814)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28825): Process ended prematurely: osmo-stp_10.42.42.5(pid=28825) [trial-2387↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28825)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=28846): Process ended prematurely: osmo-stp_10.42.42.5(pid=28846) [trial-2387↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28846)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28858): Process ended prematurely: osmo-stp_10.42.42.5(pid=28858) [trial-2387↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28858)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=28876): Process ended prematurely: osmo-stp_10.42.42.5(pid=28876) [trial-2387↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28876)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28889): Process ended prematurely: osmo-stp_10.42.42.5(pid=28889) [trial-2387↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28889)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28899): Process ended prematurely: osmo-stp_10.42.42.5(pid=28899) [trial-2387↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28916): Process ended prematurely: osmo-stp_10.42.42.5(pid=28916) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28916)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=28928): Process ended prematurely: osmo-stp_10.42.42.5(pid=28928) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28928)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=28946): Process ended prematurely: osmo-stp_10.42.42.5(pid=28946) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28946)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28956): Process ended prematurely: osmo-stp_10.42.42.5(pid=28956) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28956)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28966): Process ended prematurely: osmo-stp_10.42.42.5(pid=28966) [trial-2387↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28966)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28984): Process ended prematurely: osmo-stp_10.42.42.5(pid=28984) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28984)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=28996): Process ended prematurely: osmo-stp_10.42.42.5(pid=28996) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28996)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=29015): Process ended prematurely: osmo-stp_10.42.42.5(pid=29015) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29025): Process ended prematurely: osmo-stp_10.42.42.5(pid=29025) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29025)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29036): Process ended prematurely: osmo-stp_10.42.42.5(pid=29036) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29036)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29058): Process ended prematurely: osmo-stp_10.42.42.5(pid=29058) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29058)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29070): Process ended prematurely: osmo-stp_10.42.42.5(pid=29070) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29088): Process ended prematurely: osmo-stp_10.42.42.5(pid=29088) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29088)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29098): Process ended prematurely: osmo-stp_10.42.42.5(pid=29098) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29098)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29108): Process ended prematurely: osmo-stp_10.42.42.5(pid=29108) [trial-2387↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29108)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29125): Process ended prematurely: osmo-stp_10.42.42.5(pid=29125) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29125)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=29137): Process ended prematurely: osmo-stp_10.42.42.5(pid=29137) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29137)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29155): Process ended prematurely: osmo-stp_10.42.42.5(pid=29155) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29155)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29165): Process ended prematurely: osmo-stp_10.42.42.5(pid=29165) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29165)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29197): Process ended prematurely: osmo-stp_10.42.42.5(pid=29197) [trial-2387↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29197)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29212): Process ended prematurely: osmo-stp_10.42.42.5(pid=29212) [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29212)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29226): Process ended prematurely: osmo-stp_10.42.42.5(pid=29226) [trial-2387↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29226)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29234): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29234) [trial-2387↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29234)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29244): Process ended prematurely: osmo-stp_10.42.42.5(pid=29244) [trial-2387↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29244)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29253): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29253) [trial-2387↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29253)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29265): Process ended prematurely: osmo-stp_10.42.42.5(pid=29265) [trial-2387↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29265)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29279): Process ended prematurely: osmo-stp_10.42.42.5(pid=29279) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29279)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29290): Process ended prematurely: osmo-stp_10.42.42.5(pid=29290) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29290)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29304): Process ended prematurely: osmo-stp_10.42.42.5(pid=29304) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29315): Process ended prematurely: osmo-stp_10.42.42.5(pid=29315) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29315)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29329): Process ended prematurely: osmo-stp_10.42.42.5(pid=29329) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29329)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29340): Process ended prematurely: osmo-stp_10.42.42.5(pid=29340) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29340)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29354): Process ended prematurely: osmo-stp_10.42.42.5(pid=29354) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29354)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29365): Process ended prematurely: osmo-stp_10.42.42.5(pid=29365) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29379): Process ended prematurely: osmo-stp_10.42.42.5(pid=29379) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29379)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29391): Process ended prematurely: osmo-stp_10.42.42.5(pid=29391) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29405): Process ended prematurely: osmo-stp_10.42.42.5(pid=29405) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29405)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29417): Process ended prematurely: osmo-stp_10.42.42.5(pid=29417) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29417)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29433): Process ended prematurely: osmo-stp_10.42.42.5(pid=29433) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29444): Process ended prematurely: osmo-stp_10.42.42.5(pid=29444) [trial-2387↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29444)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29459): Process ended prematurely: osmo-stp_10.42.42.5(pid=29459) [trial-2387↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29459)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2387↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29488): Process ended prematurely: osmo-stp_10.42.42.5(pid=29488) [trial-2387↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29488)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29500): Process ended prematurely: osmo-stp_10.42.42.5(pid=29500) [trial-2387↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29500)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2387↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29529): Process ended prematurely: osmo-stp_10.42.42.5(pid=29529) [trial-2387↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29529)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29539): Process ended prematurely: osmo-stp_10.42.42.5(pid=29539) [trial-2387↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29539)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29560): Process ended prematurely: osmo-stp_10.42.42.5(pid=29560) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29560)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29572): Process ended prematurely: osmo-stp_10.42.42.5(pid=29572) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29572)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=29590): Process ended prematurely: osmo-stp_10.42.42.5(pid=29590) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29600): Process ended prematurely: osmo-stp_10.42.42.5(pid=29600) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29600)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29610): Process ended prematurely: osmo-stp_10.42.42.5(pid=29610) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29610)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29631): Process ended prematurely: osmo-stp_10.42.42.5(pid=29631) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29631)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=29643): Process ended prematurely: osmo-stp_10.42.42.5(pid=29643) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29643)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29663): Process ended prematurely: osmo-stp_10.42.42.5(pid=29663) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29663)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29673): Process ended prematurely: osmo-stp_10.42.42.5(pid=29673) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29673)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29683): Process ended prematurely: osmo-stp_10.42.42.5(pid=29683) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29683)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29700): Process ended prematurely: osmo-stp_10.42.42.5(pid=29700) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29700)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=29730): Process ended prematurely: osmo-stp_10.42.42.5(pid=29730) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29730)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29740): Process ended prematurely: osmo-stp_10.42.42.5(pid=29740) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29740)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29750): Process ended prematurely: osmo-stp_10.42.42.5(pid=29750) [trial-2387↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29750)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29764): Process ended prematurely: osmo-stp_10.42.42.5(pid=29764) [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29764)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29779): Process ended prematurely: osmo-stp_10.42.42.5(pid=29779) [trial-2387↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29779)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=29787): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29787) [trial-2387↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29787)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29797): Process ended prematurely: osmo-stp_10.42.42.5(pid=29797) [trial-2387↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29797)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29806): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29806) [trial-2387↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29806)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29816): Process ended prematurely: osmo-stp_10.42.42.5(pid=29816) [trial-2387↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29816)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30101): Process ended prematurely: osmo-stp_10.42.42.5(pid=30101) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=30112): Process ended prematurely: osmo-stp_10.42.42.5(pid=30112) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30112)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30128): Process ended prematurely: osmo-stp_10.42.42.5(pid=30128) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30128)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30139): Process ended prematurely: osmo-stp_10.42.42.5(pid=30139) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30139)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30153): Process ended prematurely: osmo-stp_10.42.42.5(pid=30153) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30153)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30164): Process ended prematurely: osmo-stp_10.42.42.5(pid=30164) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30164)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30178): Process ended prematurely: osmo-stp_10.42.42.5(pid=30178) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30178)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30192): Process ended prematurely: osmo-stp_10.42.42.5(pid=30192) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30206): Process ended prematurely: osmo-stp_10.42.42.5(pid=30206) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30217): Process ended prematurely: osmo-stp_10.42.42.5(pid=30217) [trial-2387↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30231): Process ended prematurely: osmo-stp_10.42.42.5(pid=30231) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30256): Process ended prematurely: osmo-stp_10.42.42.5(pid=30256) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30267): Process ended prematurely: osmo-stp_10.42.42.5(pid=30267) [trial-2387↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30281): Process ended prematurely: osmo-stp_10.42.42.5(pid=30281) [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30281)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30292): Process ended prematurely: osmo-stp_10.42.42.5(pid=30292) [trial-2387↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30292)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30306): Process ended prematurely: osmo-stp_10.42.42.5(pid=30306) [trial-2387↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30306)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30317): Process ended prematurely: osmo-stp_10.42.42.5(pid=30317) [trial-2387↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30317)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30336): Process ended prematurely: osmo-stp_10.42.42.5(pid=30336) [trial-2387↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30348): Process ended prematurely: osmo-stp_10.42.42.5(pid=30348) [trial-2387↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30348)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30366): Process ended prematurely: osmo-stp_10.42.42.5(pid=30366) [trial-2387↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30366)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30376): Process ended prematurely: osmo-stp_10.42.42.5(pid=30376) [trial-2387↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30376)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30386): Process ended prematurely: osmo-stp_10.42.42.5(pid=30386) [trial-2387↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30386)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30404): Process ended prematurely: osmo-stp_10.42.42.5(pid=30404) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30404)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=30416): Process ended prematurely: osmo-stp_10.42.42.5(pid=30416) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30416)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=30434): Process ended prematurely: osmo-stp_10.42.42.5(pid=30434) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30434)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30444): Process ended prematurely: osmo-stp_10.42.42.5(pid=30444) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30444)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30454): Process ended prematurely: osmo-stp_10.42.42.5(pid=30454) [trial-2387↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30454)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=30475): Process ended prematurely: osmo-stp_10.42.42.5(pid=30475) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30475)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30487): Process ended prematurely: osmo-stp_10.42.42.5(pid=30487) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30487)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=30506): Process ended prematurely: osmo-stp_10.42.42.5(pid=30506) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30506)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30516): Process ended prematurely: osmo-stp_10.42.42.5(pid=30516) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30516)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30526): Process ended prematurely: osmo-stp_10.42.42.5(pid=30526) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30526)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=30546): Process ended prematurely: osmo-stp_10.42.42.5(pid=30546) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30546)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=30558): Process ended prematurely: osmo-stp_10.42.42.5(pid=30558) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30558)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=30576): Process ended prematurely: osmo-stp_10.42.42.5(pid=30576) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30576)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30587): Process ended prematurely: osmo-stp_10.42.42.5(pid=30587) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30587)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30599): Process ended prematurely: osmo-stp_10.42.42.5(pid=30599) [trial-2387↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30599)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30616): Process ended prematurely: osmo-stp_10.42.42.5(pid=30616) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30616)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30628): Process ended prematurely: osmo-stp_10.42.42.5(pid=30628) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30628)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30646): Process ended prematurely: osmo-stp_10.42.42.5(pid=30646) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30646)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30666): Process ended prematurely: osmo-stp_10.42.42.5(pid=30666) [trial-2387↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30666)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30682): Process ended prematurely: osmo-stp_10.42.42.5(pid=30682) [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30682)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30697): Process ended prematurely: osmo-stp_10.42.42.5(pid=30697) [trial-2387↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30697)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30705) [trial-2387↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30705)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30715): Process ended prematurely: osmo-stp_10.42.42.5(pid=30715) [trial-2387↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30715)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30724) [trial-2387↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30724)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=30734): Process ended prematurely: osmo-stp_10.42.42.5(pid=30734) [trial-2387↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30749): Process ended prematurely: osmo-stp_10.42.42.5(pid=30749) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30749)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30775): Process ended prematurely: osmo-stp_10.42.42.5(pid=30775) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30775)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30786): Process ended prematurely: osmo-stp_10.42.42.5(pid=30786) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30786)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30800): Process ended prematurely: osmo-stp_10.42.42.5(pid=30800) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30800)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30811): Process ended prematurely: osmo-stp_10.42.42.5(pid=30811) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30811)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30825): Process ended prematurely: osmo-stp_10.42.42.5(pid=30825) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30825)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30836): Process ended prematurely: osmo-stp_10.42.42.5(pid=30836) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30836)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30850): Process ended prematurely: osmo-stp_10.42.42.5(pid=30850) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30850)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30861): Process ended prematurely: osmo-stp_10.42.42.5(pid=30861) [trial-2387↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30861)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30876): Process ended prematurely: osmo-stp_10.42.42.5(pid=30876) [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30876)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30887): Process ended prematurely: osmo-stp_10.42.42.5(pid=30887) [trial-2387↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30887)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30904): Process ended prematurely: osmo-stp_10.42.42.5(pid=30904) [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30915): Process ended prematurely: osmo-stp_10.42.42.5(pid=30915) [trial-2387↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30915)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30929): Process ended prematurely: osmo-stp_10.42.42.5(pid=30929) [trial-2387↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30929)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30940): Process ended prematurely: osmo-stp_10.42.42.5(pid=30940) [trial-2387↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30959): Process ended prematurely: osmo-stp_10.42.42.5(pid=30959) [trial-2387↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30959)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30971): Process ended prematurely: osmo-stp_10.42.42.5(pid=30971) [trial-2387↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30971)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=30989): Process ended prematurely: osmo-stp_10.42.42.5(pid=30989) [trial-2387↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30989)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31000): Process ended prematurely: osmo-stp_10.42.42.5(pid=31000) [trial-2387↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31000)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31010): Process ended prematurely: osmo-stp_10.42.42.5(pid=31010) [trial-2387↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=31027): Process ended prematurely: osmo-stp_10.42.42.5(pid=31027) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=31039): Process ended prematurely: osmo-stp_10.42.42.5(pid=31039) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31039)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=31057): Process ended prematurely: osmo-stp_10.42.42.5(pid=31057) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31057)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31067): Process ended prematurely: osmo-stp_10.42.42.5(pid=31067) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31077): Process ended prematurely: osmo-stp_10.42.42.5(pid=31077) [trial-2387↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31077)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=31099): Process ended prematurely: osmo-stp_10.42.42.5(pid=31099) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31099)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=31111): Process ended prematurely: osmo-stp_10.42.42.5(pid=31111) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31111)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31129): Process ended prematurely: osmo-stp_10.42.42.5(pid=31129) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31129)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31140): Process ended prematurely: osmo-stp_10.42.42.5(pid=31140) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31140)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31150): Process ended prematurely: osmo-stp_10.42.42.5(pid=31150) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31150)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=31439): Process ended prematurely: osmo-stp_10.42.42.5(pid=31439) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31439)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31451): Process ended prematurely: osmo-stp_10.42.42.5(pid=31451) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31451)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31470): Process ended prematurely: osmo-stp_10.42.42.5(pid=31470) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31470)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31481): Process ended prematurely: osmo-stp_10.42.42.5(pid=31481) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31481)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31491): Process ended prematurely: osmo-stp_10.42.42.5(pid=31491) [trial-2387↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31491)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31504): Process ended prematurely: osmo-stp_10.42.42.5(pid=31504) [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31504)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31530): Process ended prematurely: osmo-stp_10.42.42.5(pid=31530) [trial-2387↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31530)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=31638): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31638) [trial-2387↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31638)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31916): Process ended prematurely: osmo-stp_10.42.42.5(pid=31916) [trial-2387↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31916)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=32084): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32084) [trial-2387↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32084)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=32094): Process ended prematurely: osmo-stp_10.42.42.5(pid=32094) [trial-2387↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32094)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32108): Process ended prematurely: osmo-stp_10.42.42.5(pid=32108) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32108)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32120): Process ended prematurely: osmo-stp_10.42.42.5(pid=32120) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32120)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32134): Process ended prematurely: osmo-stp_10.42.42.5(pid=32134) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32134)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32145): Process ended prematurely: osmo-stp_10.42.42.5(pid=32145) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32145)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32159): Process ended prematurely: osmo-stp_10.42.42.5(pid=32159) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32159)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32170): Process ended prematurely: osmo-stp_10.42.42.5(pid=32170) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32170)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32184): Process ended prematurely: osmo-stp_10.42.42.5(pid=32184) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32184)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32195): Process ended prematurely: osmo-stp_10.42.42.5(pid=32195) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32195)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32209): Process ended prematurely: osmo-stp_10.42.42.5(pid=32209) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32209)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32220): Process ended prematurely: osmo-stp_10.42.42.5(pid=32220) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32220)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32234): Process ended prematurely: osmo-stp_10.42.42.5(pid=32234) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32234)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32245): Process ended prematurely: osmo-stp_10.42.42.5(pid=32245) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32245)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32259): Process ended prematurely: osmo-stp_10.42.42.5(pid=32259) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32259)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32270): Process ended prematurely: osmo-stp_10.42.42.5(pid=32270) [trial-2387↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32270)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32284): Process ended prematurely: osmo-stp_10.42.42.5(pid=32284) [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32284)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32295): Process ended prematurely: osmo-stp_10.42.42.5(pid=32295) [trial-2387↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32295)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32315): Process ended prematurely: osmo-stp_10.42.42.5(pid=32315) [trial-2387↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32315)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=32327): Process ended prematurely: osmo-stp_10.42.42.5(pid=32327) [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32327)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=32345): Process ended prematurely: osmo-stp_10.42.42.5(pid=32345) [trial-2387↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32345)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32355): Process ended prematurely: osmo-stp_10.42.42.5(pid=32355) [trial-2387↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32355)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32365): Process ended prematurely: osmo-stp_10.42.42.5(pid=32365) [trial-2387↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32365)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32382): Process ended prematurely: osmo-stp_10.42.42.5(pid=32382) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32382)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=32394): Process ended prematurely: osmo-stp_10.42.42.5(pid=32394) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32394)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=32415): Process ended prematurely: osmo-stp_10.42.42.5(pid=32415) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32415)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32425): Process ended prematurely: osmo-stp_10.42.42.5(pid=32425) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32425)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32435): Process ended prematurely: osmo-stp_10.42.42.5(pid=32435) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32435)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=32452): Process ended prematurely: osmo-stp_10.42.42.5(pid=32452) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=32466): Process ended prematurely: osmo-stp_10.42.42.5(pid=32466) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32466)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32484): Process ended prematurely: osmo-stp_10.42.42.5(pid=32484) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32494): Process ended prematurely: osmo-stp_10.42.42.5(pid=32494) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32494)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32504): Process ended prematurely: osmo-stp_10.42.42.5(pid=32504) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32504)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=32522): Process ended prematurely: osmo-stp_10.42.42.5(pid=32522) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32522)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=32534): Process ended prematurely: osmo-stp_10.42.42.5(pid=32534) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32534)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32552): Process ended prematurely: osmo-stp_10.42.42.5(pid=32552) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32552)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32563): Process ended prematurely: osmo-stp_10.42.42.5(pid=32563) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32573): Process ended prematurely: osmo-stp_10.42.42.5(pid=32573) [trial-2387↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32573)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32586): Process ended prematurely: osmo-stp_10.42.42.5(pid=32586) [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32586)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32599): Process ended prematurely: osmo-stp_10.42.42.5(pid=32599) [trial-2387↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32599)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=32607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32607) [trial-2387↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32607)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32619): Process ended prematurely: osmo-stp_10.42.42.5(pid=32619) [trial-2387↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32619)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32628): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32628) [trial-2387↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32628)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32638): Process ended prematurely: osmo-stp_10.42.42.5(pid=32638) [trial-2387↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32638)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32652): Process ended prematurely: osmo-stp_10.42.42.5(pid=32652) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32652)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32664): Process ended prematurely: osmo-stp_10.42.42.5(pid=32664) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32678): Process ended prematurely: osmo-stp_10.42.42.5(pid=32678) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32689): Process ended prematurely: osmo-stp_10.42.42.5(pid=32689) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32689)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32703): Process ended prematurely: osmo-stp_10.42.42.5(pid=32703) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32703)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32714): Process ended prematurely: osmo-stp_10.42.42.5(pid=32714) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32714)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32728): Process ended prematurely: osmo-stp_10.42.42.5(pid=32728) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32728)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32739): Process ended prematurely: osmo-stp_10.42.42.5(pid=32739) [trial-2387↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32739)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32753): Process ended prematurely: osmo-stp_10.42.42.5(pid=32753) [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32753)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32767): Process ended prematurely: osmo-stp_10.42.42.5(pid=32767) [trial-2387↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32767)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=316): Process ended prematurely: osmo-stp_10.42.42.5(pid=316) [trial-2387↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=316)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=327): Process ended prematurely: osmo-stp_10.42.42.5(pid=327) [trial-2387↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=327)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=406): Process ended prematurely: osmo-stp_10.42.42.5(pid=406) [trial-2387↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=406)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=419): Process ended prematurely: osmo-stp_10.42.42.5(pid=419) [trial-2387↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=419)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=437): Process ended prematurely: osmo-stp_10.42.42.5(pid=437) [trial-2387↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=437)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=447): Process ended prematurely: osmo-stp_10.42.42.5(pid=447) [trial-2387↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=447)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=457): Process ended prematurely: osmo-stp_10.42.42.5(pid=457) [trial-2387↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=457)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=474): Process ended prematurely: osmo-stp_10.42.42.5(pid=474) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=474)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=486): Process ended prematurely: osmo-stp_10.42.42.5(pid=486) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=486)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=504): Process ended prematurely: osmo-stp_10.42.42.5(pid=504) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=514): Process ended prematurely: osmo-stp_10.42.42.5(pid=514) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=514)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=524): Process ended prematurely: osmo-stp_10.42.42.5(pid=524) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=524)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=541): Process ended prematurely: osmo-stp_10.42.42.5(pid=541) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=541)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=553): Process ended prematurely: osmo-stp_10.42.42.5(pid=553) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=571): Process ended prematurely: osmo-stp_10.42.42.5(pid=571) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=571)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=581): Process ended prematurely: osmo-stp_10.42.42.5(pid=581) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=591): Process ended prematurely: osmo-stp_10.42.42.5(pid=591) [trial-2387↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=591)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=606): Process ended prematurely: osmo-stp_10.42.42.5(pid=606) [trial-2387↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=606)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=910): Process ended prematurely: osmo-stp_10.42.42.5(pid=910) [trial-2387↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=925): Process ended prematurely: osmo-nitb_10.42.42.2(pid=925) [trial-2387↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=925)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=937): Process ended prematurely: osmo-stp_10.42.42.5(pid=937) [trial-2387↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=937)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=951): Process ended prematurely: osmo-stp_10.42.42.5(pid=951) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=951)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=964): Process ended prematurely: osmo-stp_10.42.42.5(pid=964) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=964)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=978): Process ended prematurely: osmo-stp_10.42.42.5(pid=978) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=978)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=990): Process ended prematurely: osmo-stp_10.42.42.5(pid=990) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=990)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1012): Process ended prematurely: osmo-stp_10.42.42.5(pid=1012) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1012)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1023): Process ended prematurely: osmo-stp_10.42.42.5(pid=1023) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1023)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1037): Process ended prematurely: osmo-stp_10.42.42.5(pid=1037) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1037)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1048): Process ended prematurely: osmo-stp_10.42.42.5(pid=1048) [trial-2387↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1048)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1062): Process ended prematurely: osmo-stp_10.42.42.5(pid=1062) [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1062)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1073): Process ended prematurely: osmo-stp_10.42.42.5(pid=1073) [trial-2387↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1073)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1087): Process ended prematurely: osmo-stp_10.42.42.5(pid=1087) [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1087)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1098): Process ended prematurely: osmo-stp_10.42.42.5(pid=1098) [trial-2387↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1098)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1112): Process ended prematurely: osmo-stp_10.42.42.5(pid=1112) [trial-2387↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1112)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1129): Process ended prematurely: osmo-stp_10.42.42.5(pid=1129) [trial-2387↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1129)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=1153): Process ended prematurely: osmo-stp_10.42.42.5(pid=1153) [trial-2387↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1177): Process ended prematurely: osmo-stp_10.42.42.5(pid=1177) [trial-2387↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1177)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1195): Process ended prematurely: osmo-stp_10.42.42.5(pid=1195) [trial-2387↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1195)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1205): Process ended prematurely: osmo-stp_10.42.42.5(pid=1205) [trial-2387↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1205)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1215): Process ended prematurely: osmo-stp_10.42.42.5(pid=1215) [trial-2387↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1215)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=1233): Process ended prematurely: osmo-stp_10.42.42.5(pid=1233) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1233)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=1245): Process ended prematurely: osmo-stp_10.42.42.5(pid=1245) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1245)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=1263): Process ended prematurely: osmo-stp_10.42.42.5(pid=1263) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1263)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1273): Process ended prematurely: osmo-stp_10.42.42.5(pid=1273) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1273)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1283): Process ended prematurely: osmo-stp_10.42.42.5(pid=1283) [trial-2387↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1283)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=1300): Process ended prematurely: osmo-stp_10.42.42.5(pid=1300) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1300)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1313): Process ended prematurely: osmo-stp_10.42.42.5(pid=1313) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1313)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=1331): Process ended prematurely: osmo-stp_10.42.42.5(pid=1331) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1331)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1341): Process ended prematurely: osmo-stp_10.42.42.5(pid=1341) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1341)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1351): Process ended prematurely: osmo-stp_10.42.42.5(pid=1351) [trial-2387↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1351)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=1370): Process ended prematurely: osmo-stp_10.42.42.5(pid=1370) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1370)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1392): Process ended prematurely: osmo-stp_10.42.42.5(pid=1392) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1392)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1761): Process ended prematurely: osmo-stp_10.42.42.5(pid=1761) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1761)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1952): Process ended prematurely: osmo-stp_10.42.42.5(pid=1952) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1952)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1962): Process ended prematurely: osmo-stp_10.42.42.5(pid=1962) [trial-2387↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1962)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1979): Process ended prematurely: osmo-stp_10.42.42.5(pid=1979) [trial-2387↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1979)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=1987): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1987) [trial-2387↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1987)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=1989): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1989) [trial-2387↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1989)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=1991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1991) [trial-2387↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1991)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=1993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1993) [trial-2387↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1993)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.4 sec) Error: osmo-hlr_10.42.42.2(pid=2002): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2002) [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)] FAIL: esme_connect_policy_closed.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=2013): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2013) [trial-2387↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2013)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2025): Process ended prematurely: osmo-stp_10.42.42.5(pid=2025) [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2387↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2050): Process ended prematurely: osmo-stp_10.42.42.5(pid=2050) [trial-2387↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2050)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2062): Process ended prematurely: osmo-stp_10.42.42.5(pid=2062) [trial-2387↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2062)] FAIL: register_a5_1_authreq.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2073): Process ended prematurely: osmo-stp_10.42.42.5(pid=2073) [trial-2387↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2073)] FAIL: register_a5_3_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2084): Process ended prematurely: osmo-stp_10.42.42.5(pid=2084) [trial-2387↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2084)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.7 sec) Error: srsepc(pid=2104): Process ended prematurely: srsepc(pid=2104) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2104)] FAIL: iperf3_bidir.py (18.7 sec) Error: srsepc(pid=2120): Process ended prematurely: srsepc(pid=2120) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2120)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=2136): Process ended prematurely: srsepc(pid=2136) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2136)] FAIL: iperf3_ul.py (18.5 sec) Error: srsepc(pid=2152): Process ended prematurely: srsepc(pid=2152) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2152)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=2168): Process ended prematurely: srsepc(pid=2168) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2168)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=2184): Process ended prematurely: srsepc(pid=2184) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2184)] FAIL: rrc_idle_mt_ping.py (18.7 sec) Error: srsepc(pid=2201): Process ended prematurely: srsepc(pid=2201) [trial-2387↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2201)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2216): Process ended prematurely: osmo-stp_10.42.42.5(pid=2216) [trial-2387↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2216)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2231): Process ended prematurely: osmo-stp_10.42.42.5(pid=2231) [trial-2387↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2231)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2255): Process ended prematurely: osmo-stp_10.42.42.5(pid=2255) [trial-2387↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2622): Process ended prematurely: osmo-stp_10.42.42.5(pid=2622) [trial-2387↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2622)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2813): Process ended prematurely: osmo-stp_10.42.42.5(pid=2813) [trial-2387↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2813)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2827): Process ended prematurely: osmo-stp_10.42.42.5(pid=2827) [trial-2387↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2827)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2843): Process ended prematurely: osmo-stp_10.42.42.5(pid=2843) [trial-2387↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2843)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2857): Process ended prematurely: osmo-stp_10.42.42.5(pid=2857) [trial-2387↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2857)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2871): Process ended prematurely: osmo-stp_10.42.42.5(pid=2871) [trial-2387↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2871)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2885): Process ended prematurely: osmo-stp_10.42.42.5(pid=2885) [trial-2387↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2885)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2899): Process ended prematurely: osmo-stp_10.42.42.5(pid=2899) [trial-2387↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2899)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2913): Process ended prematurely: osmo-stp_10.42.42.5(pid=2913) [trial-2387↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2913)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2927): Process ended prematurely: osmo-stp_10.42.42.5(pid=2927) [trial-2387↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2927)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=2941): Process ended prematurely: osmo-stp_10.42.42.5(pid=2941) [trial-2387↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2941)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2955): Process ended prematurely: osmo-stp_10.42.42.5(pid=2955) [trial-2387↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2955)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2969): Process ended prematurely: osmo-stp_10.42.42.5(pid=2969) [trial-2387↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2969)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2983): Process ended prematurely: osmo-stp_10.42.42.5(pid=2983) [trial-2387↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2983)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2997): Process ended prematurely: osmo-stp_10.42.42.5(pid=2997) [trial-2387↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2997)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3011): Process ended prematurely: osmo-stp_10.42.42.5(pid=3011) [trial-2387↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3011)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3025): Process ended prematurely: osmo-stp_10.42.42.5(pid=3025) [trial-2387↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3025)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3039): Process ended prematurely: osmo-stp_10.42.42.5(pid=3039) [trial-2387↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3039)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=3153): Process ended prematurely: osmo-stp_10.42.42.5(pid=3153) [trial-2387↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3153)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=3338): Process ended prematurely: osmo-stp_10.42.42.5(pid=3338) [trial-2387↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3338)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3352): Process ended prematurely: osmo-stp_10.42.42.5(pid=3352) [trial-2387↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3352)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3366): Process ended prematurely: osmo-stp_10.42.42.5(pid=3366) [trial-2387↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3366)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3381): Process ended prematurely: osmo-stp_10.42.42.5(pid=3381) [trial-2387↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3381)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3395): Process ended prematurely: osmo-stp_10.42.42.5(pid=3395) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3395)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3410): Process ended prematurely: osmo-stp_10.42.42.5(pid=3410) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3410)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3427): Process ended prematurely: osmo-stp_10.42.42.5(pid=3427) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3427)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3441): Process ended prematurely: osmo-stp_10.42.42.5(pid=3441) [trial-2387↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3441)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3455): Process ended prematurely: osmo-stp_10.42.42.5(pid=3455) [trial-2387↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3455)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3469): Process ended prematurely: osmo-stp_10.42.42.5(pid=3469) [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3469)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3483): Process ended prematurely: osmo-stp_10.42.42.5(pid=3483) [trial-2387↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3483)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3497): Process ended prematurely: osmo-stp_10.42.42.5(pid=3497) [trial-2387↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3497)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3515): Process ended prematurely: osmo-stp_10.42.42.5(pid=3515) [trial-2387↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3515)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3529): Process ended prematurely: osmo-stp_10.42.42.5(pid=3529) [trial-2387↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] + rm -rf trial-2387/inst + cd trial-2387 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 08:32:40 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387-run.tgz run.2022-12-13_08-32-52 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17679.tgz osmo-bts-oc2g.build-5536.tgz osmo-bts-sysmo.build-8040.tgz osmo-bts.build-7509.tgz osmo-ggsn.build-6689.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2984.tgz osmo-mgw.build-8958.tgz osmo-msc.build-29303.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3910.tgz osmo-pcu-sysmo.build-5192.tgz osmo-pcu.build-5153.tgz osmo-sgsn.build-30086.tgz osmo-stp.build-9255.tgz osmo-trx.build-4680.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE